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ABSTRACT 


linear Time Invariant digital filters are charact- 
erized by difference equations with constant coefficients. 
They generally require complex hardware structures when 
they are realised physically. This thesis deals with the 
development of a non-linear digital filter that is 
equivalent to a linear digital filter, in the sense that 
the expected values of their outputs are equal. It is 
shown that for a fixed input sampling rate, the power 
spectrum of the output of the nonlinear filter can be made 
to asymptotically approach the power spectrum of the 
output of the linear filter. The hardware requirement 
for the nonlinear filter is simpler than that required for 
the linear filter. A possible application of this filter 
structure is in the realisation of filter banks, and in 
the realisation of complex filters, such as a fading 
dispersive channel simula,ter. 



CHAPTER 1 
INTRODUCTION 


Digital signal processing techniques find increasing 
application over analog signal processing techniques owing 
to their greater accuracy, reproduciblity and programmability. 
Advances in integrated circuit technology have made, for the 
same accuracy, dsp techniques more economical than analog 
signal processing techniques. The theory of dsp emerged 
from an understanding of sampling and its spectral effects 
and the use of the z-transform. The integrated circuit 
implementation of digital circuits caused dsp to further evolve 
and it continues to do so today. 

The sampling of a signal is quantization of the 
signal in time. Similarly the concept of the quantization 
of the signal in amplitude developed. The late 40' s saw the 
introduction of the statistical theory of amplitude quanti- 
zation. One of the numerous uses of quantizers was in 
correlation devices. Digital signal processing used finite 
wordlength machines, which necessarily meant quantization 
in amplitude. The statistical theory of amplitude 
quantization was applied to study the finite wordlength 
effects in digital machines and, in dsp areas, specifically 
in digital filters. 



Linear digital filtering is one area of digital 
signal processing, where the digital filter is the 
implementation of a constant coefficient linear difference 
equation. The hardware realisation of a digital filter 
therefore requires a number of basic hardware units e.g. 
multipliers , delay elements, and summers, the number of 
elements increasing as the order of the filter, hence 
increasing the cost. Kirlin [7] introduced the statistical 
coarse-sampled-data filter with a view to reduce the 
hardware requirements of the linear filter. It was his 
contention that the performance of the coarse-sampled- 
data filter matched that of the linear digital filter it 
meant to replace. 

Kirlin’s nonlinear filter appears to be very- 
promising, for while it is said to be equal to the linear 
digital filter in its performance, its hardware requirement 
are simpler, implying a reduction in hardware complexity 
as well as cost. This aspect is particularly important 
in the realisation of higher order systems. For e.g., 
a digital hardware unit may simulate a fading dispersive 
channel for eg. a troposcatter channel. The large bank 
of filters required to adequately simulate multipath delays, 
and the multiplication by complex coefficients to simulate 
Rayleigh fading and Doppler Spread, require a large amount 



of complex hardware. Implementing a fading dispersive 
channel simulator using Kirlin's scheme would mean a 
big saving in hardware. 

The object of the present work . was to evaluate 
the performance of Kirlin's coarse-sampled-data filter 
with respect to that of the linear digital filter. If the 
performance of the coarse-sampled-data filter was found to 
be not equal to that of the linear digital filter, could 
the structure of the coarse-sampled-data filter be changed 
so that the performance of the modified filter matched 
closely, that of the linear digital filter? 

It was found that the performance of the coarse-sampled- 

data filter when the input was a white noise sequence, was 

nowhere near that of the linear digital filter. However, 

of 

altering the structure [_ the feedback of the coarse-sampled- 
data filter led to -what has been called 'N-bit feed-back 
sampled-data filter'. The performance of the output of the 
N-bit feedback sampled-data filter, when the input was a 
white noise sequence, was found to asymptotically 
approach that of the linear digital filter. 

Organization of Chapters : 

In Chapter 2, theory and techniques of digital 
filtering, the statistical theory of quantization and the 
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coarse-sampled-data filter' using an RC averager, are 
reviewed. In Chapter 3, the performance of the first 
order and second order linear digital filters, coarse- 
sampled -data, filters and IT-bit feedback sampled-data 
filters are evaluated, for a white noise sequence input. 
In Chapter 4, the performance of first and second order 
IT -bit feedback sampled-data filters as obtained by 
simulating the filters on the DEC-10 is discussed. 
Chapter 5 summarises the results obtained in Chapters 
3 and 4. 



Chapter 2 

REVIEW OE DIGITAL SIGNAL PROCESSING AND THE STATISTICAL 

THEORY OE QUANTISATION 

In this chapter, digital filter design techniques, 
effects of quantization on analog signals, use of quantizers 
for autocorrelation determination, and the statistical coarse- 
sampled-data filter are discussed. 

2.1 RELATION BETWEEN ANALOG AND DISCRETE SYSTEMS 

The Fourier transform of an analog signal x A (t) is given 
hy 

gj 

X A ( 3 -') = J K ' k ( t ) e~^ UTt dt (2.1.1) 

Inversely x^(t) is derived from X A ( j^) hy the relation 

X- A (t) = “ jx A ( jw) e jwt d«> (2.1.2) 

If X (t) he sampled, with sampling rate l/T, it can he shown [l] 
that for the resultant signal x(nT), the Fourier transform is 
given hy 

KK) = f £ X A (owY”kwT) (2.1.3) 

k=— ° 

where uj is the sampling frequency in radians and oj = 2n/T . 

S s 

X(jc**) is obviously periodic with period 27t/T. 
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If X A (ju>) is band-limited over the range (-n/T, %/*£),> then 
( 3 w) and X(jo>) are identical in this frequency range. Other- 
wise a condition known as 'aliasing' occurs. 


When x A (t) is a stationary stochastic process, it can he 
shown [2], that the ensemble autocorrelation function R (1) 

jL 

of the sequence x(nT) and the ensemble autocorrelation function 

R (t) of the analog signal x. (t) are related by 
X A a 


R ( 1 ) = R (t) 
x x A 


t=1T 


(2.1 . 4 ) 


It can also be shown [ 2 ] that if x A (t) is ergodic in the 
Autocorrelation sense then the time autocorrelation 

function of x A (t), defined by 

K 

= 1“ 2TTT j X A ^ x aO*' e > dt 

A K— 4 

and the time autocorrelation function R^(l) of the 

sampled signal x(nT) defined in like manner, are related ??s 
follows : 


<(D = H* (t) 

x x A 


t= 1 T 


(2.1 . 5 ) 


The power spectrum and the ensemble AC 5 F of x A (t) form a 
Fourier transform pair thus i 


and 


S_ ( j l - J ) ^R (t) 

A X A 

S (jew) = R (t) dr 

X A J X A 


( 2 . 1 . 6 ) 
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The power spectrum of the sampled signal x(nT) is given by 

co 


S x (j^T) 


s *(*)i 


z=e 


3 ill 




b*00 * 


-k 


z=e 


j-O-T 


(2,1.7) 


= ^[R x (m) 6(m~kT) } 

Eqn. (2.1.4) effectively implies that 6^.(1) may be obtained by 

sampling ft ( x ) at T second intervals and because 
S A 

R (x)±~>S (j£>) 

X A X A 

oo 

S x ( 3^T) =£[R x (k)] = 1 21 S x (30T=~W s r) (2.1.8) 

m 11 — A 


by invoking the relation (2.1.3). 

2.2 DIGITAL FILTER DESIGN TECHNIQUES 


2.2.1 Filter Properties : 

Important properties of digital filters are magnitude 
squared response H(e^ to ) 2 , phase delay I (to) , and group or 

Jr 

envelope delay T (to) . 

e> 

If the filter transfer function is given by H(z), then 


E( e ^° ) 2 = [H(z) H(z~ 1 )] 7 _J^ 


T p (j w ) 


Tan 


I m (H(z)) j 

I 



In 


C^r 

H( z ] ) 


3 


z=e 


3 to 


(2.2.1) 

( 2 . 2 . 2 ) 


(2.2.3) 
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. dT (a) | 

TgCjW ) = ” dT T p^^‘) = ”DZ ^ j _ j£o (2.2.4) 
Tg(jW) = -Ee[ S (4-|l2l) ^ ] _ j0J (2.2.5) 

2— G 


= - Re[z (In H(z))] (2.2.6) 

Those poles of H(e^°~’) ^ that lie inside the unit circle in 
the z -plane are determined, to be the poles of II(z). The zeros 
of H(z) are not uniquely determined, but choosing them to be 
those zeros of H(e^’ ) ^ that lie inside or on the unit circle, 
yields a minimum phase filter. Some signal processing applica- 
tions require the filter to be linear phase i.e. that the group 
delay be zero or a constant over the frequency bands of interest. 

2.2.2 Finite Duration Impulse Response Filters : 

Two widely used filter types are FIR and HR filters. 

Some advantages of FIR filters are that they are always stable 
and using an appropriate delay can always be realized. They 
can be designed to yield exactly linear phase, a condition 
required for speech signal processing an^ data transmission. 
Disadvantages of FIR filters are that a large value of impulse 
response duration is required to adequately approximate sharply 
cut off filters, hence requiring a large amount of computation 
and time. But with the advent of the FFT, fast convolution has 
been made possible, so that FIR filters are now competitive 



2.5 


with sharp cut-off IIT filter designs. If an FIR filter with 
impulse response duration = N, be required to be linear phase 
with I ( 3 a.) = -a then 

Jr 

a = (2.2.7) 

and h(n) = h(B-l--n) (2.2.8) 

where ih(n), n = 0 , . . . , i is the impulse response 
sequence . 

FIR Filter design techniques : 

(a) Windowing : The Fourier Transform of the impulse response 
of a digital filter is periodic and it can be expanded in a 
Fourier series thus i 


/_ h(n) n 


(2.2.9) 


where | h(n) J is the impulse response of the filter and 
given by 

2 ix 

h(n) =™ f E(e^ Ji ) da> , 

0 ( 2 . 2 . 10 ) 


{ 1 

Because i h(n) ( extends from - < n < «=> , the filter is 

l .) 

unrealizable. A finite weighting function w(m) is used to 


modify the Fourier coefficients \ h(n)j so that 

h(n) = w(n).h(n). Then if H(e^ UJ ) h(n) , H(e^ a ‘ ) should 
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approximate H(e^ u ") within some permissible error. Clearly 
) ig c i rcu xar convolution of v( e 3h>) an( j 

IfW(e^ ) = 6(00) then H ( e ^ ^ ) = E(e^' , ' L ' ), but if w(n) is a 
finite sequence, W(e‘ i/, ° ) is not an impulse. Then W(e‘' 0 ~' ) must 
be chosen such that its main lobe has a small width and. hence 
higher energy concentration! the side lobes should decreese in 
energy rapidly as C<o -- •?> tc. Some windows used are Rectangular 
window, Hamming window, Kaiser window. 


(b) Frequency Sampling : Given N equally spaced points 


| H(k) \ in the DFT of an impulse response sequence, the 


j 


transfer function H(z) can be found [l, pp 105-107] to be 

-N 


H(z) = 


1-z 


I'M 


k=0 


M 


( 1-z" 1 exp ( - ^p)) 


( 2 . 2 . 10 ) 


Here the transfer function K(z) approximates a continuous 
transfer function. The approximation error is zero at the N 
specified frequencies and finite between them. 

(c) Optimal (Min Max Error) Filters % Considering the 
linear phase FIR filter design problem as a Chebyshev Approxima- 
tion problem, a set of condition is derived for which it can 
be proved that the solution for which the peak approximation 
error over the interval of approximation is minimized , is 
optimal. Define H 0 (e J ' ) = the transfer fn. being approxi- 
mated, ¥(e J ) = a weighting function on the approximation 
error, so that the relative size of the error in different 
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frequency bands may be chosen, H(e J ) = the frequency 
response of the designed filter. Then 


E ( e ^ ^ ) = Ke^'- 01 ’) [H 0 (e^ T ) -H(e^ T )] (2.2.12) 

i 6J T 

where E(e J ) is the approximation error. Then the Ghebyshev 
approximation problem may be stated as 


E(e 


j6J T ’ 


mm 


min [max E (e jo:,T ) ] 
coeffs 4oeA 


(2.2.13) 


where A is the disjoint union of frequency bands of interest. 


Of these three design technique, the frequency sampling and 
Minmax error techniques are superior to windowing. 

2.2.3 HR Filter Design % All filter design techniques should 
lead to stable and realizable filters, therefore IIR filters 
should be such that 


h(n) =0, n < 0 

h(n) ^ > ° 


(2.2.14) 


The general form of the IIR filter transfer function is 

M E 

&(z) = (H a.z" 1 )/(l + ZL b.z" 1 ) (2.2.15) 

i=0 1 i=1 1 

where at least one b i is nonzero and the roots of the denomina- 
tor are not cancelled by roots of the numerator, which case 
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leads to an HR filter. For H(z) derived from an analog 
filter, M ^ F. 

Design Techniques ; 


Impulse Invariant Transformation : Using this transformation, 
the impulse response of the resulting digital filter is a 
sampled version of that of an analog filter. Xet H(s) have 
simple poles and M <1 F, then 


F 


C, 


H(s) = .2"- iTd. ; °i = H(s) ^ +d i). 


s=-d . 
1 


(2*2.16) 


The analog filter impulse response is given by 


F 


-d . t 


h(t ) = T C jL e 1 # u_ >1 (t) 

i=1 


F 


/. h(nT) =21 ° 


~d . t t 

t e 1 . (nT) 


i=1 


(2.2.17) 


(2.2.18) 


where T is the sampling period, 

B 

= A h(nT) z~ n = 21 


H(z) 


-d .T 


(2.2.19) 


- oo 


i=1 1 ~e 


Obviously, this uses the mapping s+d^- 


~ d i T -1 

1~e z for a 


simple pole at -di. Since H(z=e J ) is the Fourier Transform 
of the sampled signal h(t)j 

OO 

T ) = gr Z H( j isrr“k~w7) , where w G = 2n/T. 


k=- co 
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The equivalent analog filter must he hand limited to the range 
i-Ti/H, %/T) ; as T becomes larger the effect of aliasing becomes 
negligible and the digital and analog frequency responses 
become comparable. 

Bilinear Transformation s Using this technique, analog 
filters are converted to equivalent digital filters using a 
transformation [3] that maps the s -plane into the z-plane. 

The bilinear transformation is given by 


s 


2 (1 

T v 


•1 


■1 


■) 


( 2 . 2 . 20 ) 


1 + z 

in the z-plane. The LH-s plane and the BH s-plane are mapped 
inside and outside the unit circle in the z-plane respectively. 
On the unit circle z = e J ~ 




- 2 


( 1-e' 


•S&-T 


) 


( 1 + e 


-jhT 


) 


2 _l /-h-T\ 
rp tan ( 2 ) 


( 2 . 2.21 ) 


where & and are the corresponding analog and digital 
frequencies, and their relation is highly nonlinear. There- 
fore this transformation can be used only when the analog 
filter response is piecewise constant. Though realizable, 
stable analog filters are mapped to realizable digital filters, 
the nonlinear relation between bo and -iJ- leads to a highly 
warped digital filter response. 
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Matched z Transformation s The poles and zeros in the 
s~plane are mapped onto the poles and zeros in the z-plane, 
where the mapping is defined by s+a — e? i-z e where T is 
the sampling period. The matched z-transf ormation is not a 
suitable mapping when the analog filter has zeros a% centre 
frequencies greater tnan half the sampling frequency, as the 
position of the zero will be greatly aliased in the z~plane. 


Least Squares Error Method 


Assume the HR filter's transfer function is of the form 


K 1+a, z ^ + b, z ^ 

H(z) = A it — — 5 (2.2.22) 

k=1 H-c v .z” + d k z"^ 

r 5% 

Let the desired frequency response be [E (e ), i=1,2,3, ...,Mj 
where are not necessarily equally spaced. The squared 

error in frequency is Q(@) 


Q(©) 



H 0 (e 



2 


(2.2.23) 


where 

© = (a ^ ,b ^ , c ^ , d ^ , ..., (2.2.24) 

Q(©) m i n is found using methods of calculus on the computer, [l] 
provides an exhaustive study of FIR and IIR filter design 
techniques . 

% 



2,3 QUANTIZATION EFFECTS IN DIGITAL SYSTEMS 


The analysis of digital systems is "based on the theory of 
difference equations with constant coefficients. The wordlength 
of any digital system is finite. Therefore quantization of the 
input to the system and discretization of the coefficients are 
compulsory. Quantization leads to approximation of the signal 
value by one of an appropriate set of discrete levels not from 
a continuous range. This nonlinearization makes an analysis 
of the system difficult except for simple cases. A statistical 
analysis may however be carried out to determine the resultant 
distortion. 

Quantization leads to rounding or 'grouping' of input data 
samples, the range of each sample is subdivided into 'intervals' 
of equal width q. 

i *"o" k. x ^ i + •§■ i = 0, + 1 , + 2 ... 

q2 q 2 — — 

(2.3.1) 

The nonlinear quantization replaces each value of x by the 
nearest interval centre 'i '. The quantiser output x / can be 
considered the sum of the input x and a round ~off error 
referred to as 'quantisation noise' x^ 

x' = x + x^ (2 .3 .2) 

The noise x may increase the variance of x’ and bias the mean 
of the estimate x, but for an important class of random processes. 
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it has been shown that [ll] the biasing effects of quantiza- 
tion average out approximately or can be predicted and 
corrected even with coarse quantization. The statistical 
theory of Amplitude Quantization was put forward by Bsnnet [12] 
but is essentially due to Wid/iow [ll]. His principle results 
are as follows : 

let x,y be two random variables with probability density 
functions (p.d.f) p(x), p(y) and joint density function 

p(x,y) . let the characteristic functions be W (a) = E(e^ ax ) 

A 

a nd W (a^otg) = tlC ex P( 3 ( a i^ + 

The quantization theorems are defined as follows 

1. If p(x) is 'bandlimited ' so that w„(a) vanishes for 

j a| - e (o > 0), then every existing mean E[x m ] is 

completely determined by E[(x') m ] and the first order probabi- 
lity density function of x^ is uniform between (-q/2, q/2). 

2. If p(x,y) is 'bandlimited' so that W (a ,a ) vanishes 

x ? y i z 

for | a i|^' - £, | a 2 1 ~ £ > e '> then every 

existing moment E("x m y n ^) (m,n = 1,2, ...) is given by 
®(( x ') m (y') n ) and x^ and y^ are uniformly distributed and 
statistically independent. 

Widrow also gives a rigorous justification of the 
relations known as 'Sheppard's corrections'. 

E(x) = E ( x ' ) ,* E(x 2 ) =E((x’) 2 ) - jg- q 2 (2.3.3) 
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Watts [l4] has extended Widrow's theory to the case of quanti- 
zation by shifted class intervals, i.e. 


a 1 + i q 1 - q^/2 < X £ a 1 + i q 1 + q^2 
a + k q - q 9 /2 < y < a + k q + q 0 /2 


J 


(2.3.4) 


The input-output characteristic of the quantizer (x* vs x) and 
its composition into shifters, gains and unit quantiser, are 
shown in Pig. (2.3.1). The p.d.f. p(x') of the output of the 
general quantiser is 

OO 


OO 


p(x' ) = 


1 


Z [ 




-r 


C - (| - a)]dx].6(|~ -c-n) 


P(x)f-j [ 

— fL 

(2.3.5) 

f^(x) is a window function s.t. f,(x) = 1 for - i < x ^ 
f,(x) = 0 elsewhere. 6(x) is the Dirac delta function. 

The characteristic function (c.f) of x' is 


00 


W 


:<“) ‘ k J exp(- 3 .(=-a)) ezp(- j2nto ) V x (f - 2&) 

i£ — *'* OO 


q ' v ( 0 £r- 2 uk J 
(2.3.6) 

If x and y, with joint p.d.f p(x,y) are each quantised by 
general quantisers with parameters (a^l^c^r. ) , i = 1,2 


the resulting c.f. of x' and y' is W , , (a ,a ), 

oc x ,y i ^ 

¥ , ,(a ,a ) = >_ ZL exp(-j r a (c 1 -a 1 )).exp(-ja, 

x ,y 1 d k=-9»l=-« ill! * 

exp(-j2'rtka | ) exp(-j2TCla 2 ) .W x Tr (-~- - 7T~> - T 2 ^) 


>y <*-, 


sinv(a^r ^-2n:k) sin iioc^r 2 ~2tc1) 

t(a 1 r 1 -27tk) ~T(a^^2TtT) 


(2.3.7-) 
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This result may he extended to any number of jointly related 
variables. Quantize tion has previously been described as the 
addition of independent noise to the signal input to the 
quantiser, i.e. 


x' = X + x^ 

then E(x'y') = E(x+x -y+y ) = S(xy + x y + xy + x y ) (2.3.8) 

4 4 4. 4 4 4 

In terms of the c.f. 


E((x’) m (y') n ) 


(*■* 0 ) ! 


( a 1 ♦ « 2 ) 


a =cc =o 
1 2 


(2.3.9) 


let the irrespective means be subtracted from x and y, and 

w = W A— 1 - . £*£) be the c.f of p(x-x, y-y ) , it 

u u 4 -j 4 1 42 42 

is shown [l4, p 21 l] that if the c.f. W^a^oc^) be zero for 

~ then 
q 2 

E(x'y') = E(xy ) (2.3.10) 

i.e., the quantisation noises are uncorrelated with both the 
input signals and with each other. 

Use of Dither % 

If a random variable n satisfies the first & second 
quantizing theorems, and if x and n are statistically independent 
then the sum x+n also satisfies the quantizing theorems, regard- 
less of the distribution of x. Chang and Moore [l6] studied the 
modified digital correlator shown in Eig. 2.3.2. 
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Let the c .f . of n„(t) and n„(t) be W (a.) and ¥ (a_) res- 

1 d. n ^ l H2 

pectively. Chang and Moore [l6] show that the correlation 
function of the outputs of the quantizers y^ ' (t) and y^'tt) and 
that of the arbitrary inputs x^ (t) and X 2 (t) are equal iff the 
auxiliary noise waveforms n^(t), n 2 (t) are such that 

W (- ~) =0 k f 0 
1 *1 

and (2.3.11 ) 

V If > 1 - 0 1 * 0 

where q^,qg are s ^ e P sizes of the quantizers, i.e. 

E(x^ ( t ^ ) x 2 (t 2 )) =E(yj(t 1 ) y£(t 2 )) (2.3.12) 

These conditions (eqn. (2.3.H)) imply that n^(t), ^(t) should 
be such that (i) they are zero mean (ii) they are independent 
of the noise signals and of each other (iii) their p.d.fs 
should be such that their characteristic functions have periodic 
zeros with period 2"rc/q^, no zero lying at the origin. 

It is shown [16] that the rectangular distribution 


p(n) = 1/q JnJ <: q/2 

= 0 elsewhere 


(2.3.13) 


satisfies eqns. (2.3.11). The p.d.f’s which are m-f old convolu- 
tions m = 1,2, ... of the rectangular distribution with itself 
also satisfy equation (2.3.11). 
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The general form of the characteristic function of this 
family of r.v.s. is 

OC> rv n O 

W n (a) = [1 - (~ Ij) 2 ] 1 • F(a) (2.3.14) 

where nu are nonzero positive integers, and F(a) is s.t. 

F(a) ^ 1 , F(0) = 1 * For the corresponding auxiliary noise 
n(t) to be zero mean, F'(0) = 0. 

DEVICES FOR CORRELATION ESTIMATION : Correlation techniques are 
of practical importance in technology. An important use of 
these techniques is the measurement of target range and velocity 
by radar and sonar systems, and determination of the transfer 
functions of control systems. Correlation devices may be either 
analog or digital. The various categories are direct correlator, 
digital correlator [14], stieHtjes correlator [14], modified 
digital (polarity coincidence) correlator [17], relay (modified 
stieltjes) correlator [l8], modified relay correlator. Fig. 
(2.3.3) shows self explanatory schematics of these correlation 
devices . 


The Signum Function and its Approximations 


The signum function is a step function defined as 
follows i 


sgn(x) 



x < 0 
x = 0 

x > 0 


(2.3.15 ) 
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xAt) 
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(a, Direot 


Jh 


/ 


*i ,x a 


fe> 



(b) Digital Correia tar 


, (AO 

I* *2 



• ♦ . ( AT ) 
V*2 


(o) 3 tieltj «8 Correlator 
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(d) Polarity Coincidence Correlator 



(•) Modified Polarity Coincidence Corrolator 




x 2 (kT) 

(f) Relay (Modified Stieltjee) Correlator 



(g) Modified Relay Correlator 


Fig. ?. 3.3 
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The unit function is defined thus 
u(x) I = 0 x < 0 

= -g- =0 

= 1 x >0 

In terms of u(x) , therefore, sgn(x) is given by 

sgn(x) = 2u(x)-1 (2.3.16) 

The unit step u(x) may be represented as the limit of many 
continuous functions; 


’• U(X) ^ tan'' (ax)] 

(2.3,17) 

2 - UU) = Jiloi [erf (ax) + ,] 

p 

(2,3.18) 

where erf (ax) = exp(~a 2 y 2 )dy 


'0 


3. u(x) = lim r 0 (-e"” ax ) -\ 

(2.3.19) 

A. u(x) = lim 1 ax r siny 3 „ 

a _>.oo ^ J y ' ' . dy 

(2.3.20) 


These functions are illustrated in Fig. (2.3.4). 

2.4 A Statistical Ooarse-Sampled-Da ta Filter; 

In a recent publication [7], a new technique for the 
hardware implementation of digital filters is introduced. 
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By use of this technique, the complexity of the hardware 
required is sought to he reduced. The proposed filter 
requires only one summer, one shift register of length equal 
to the order of the filter, either a simple RC low pass 
filter or a digital counter, and a generator of noise 
uniformly distributed in amplitude and independent between 
samples. The principle of operation is based on polarity 
coincidence correlation [8], Fig. (2.3.3d), and is similar 
to dithering employed to over-come the effects of quantization 
in video data for e.g. [9j,[l0]. It is used when low input 
sample rate are sufficient as this filter requires a higher 
sampling rates than the direct. 

The proposed filter implementation technique is 
developed as follows 

Let x Q be a random variable with probability density 
function p(x ) . 

Let n(t) be a noise process, stationary, white, uniformly 
distributed in amplitude and independent between samples, 
lying in the range -N <n <C TSf. 

The range of x Q is included in that of n(t), or at most 
the two ranges are equal. Assume that the range of x Q is 
equal to the range of n(t) and let it be normalised so that 

» 1 < ^ 1 


(2.4.1 ) 
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Thus, the probability density of n is 


P n (a) = j -1 -<a ^ 1 
= 0 elsewhere 


( 2 . 4 * 2 ) 


Now consider the random variable z generated thus: 

(2.4.3) 


a = sgn (x Q + n(t) ) 
The conditional density p( z 


x ) is given by 


p( zf x 0 )=6(z-1 ) .p(n(t)> -x 0 )+6(Z+l )p(n(t) < -x q ) 

1 ” x o 

6(a-l) i f dn + S( 2 +1 ) f I dn 


-1 


(2.4.4) 

(2.4.5) 


•x. 


1 +x n 1 ~x^ 

= 6(Z-1) + 5 ( Z+ 1 ) -^-2- 

The conditional expectation is given by 


E(z 


V 


ap(a| x Q )da 


1+x„ 1-x rt 

a[6(a-1 ) —7T ' E 1 - ' 4 N u 


z 


1+2 1-2 

1 0 , 0 

j m —— 1- ~ 


(-1 ) = X, 


( 2 . 4 . 6 ) 


(2.4.7) 


+ 6(a+l) — 7c~ ].da 


( 2 . 4 . 8 ) 

(2.4.9) 


E(a) = E(x Q ) (2.4.10) 

An intuitive explanation of eqn. (2.4.10) may be 


given. Consider the case when x Q varies slowly in time 



2.25 


w.r.t. n(t). The dithering signal n(t) is added to x say 
E times in a period of secsj each time the sum p is formed. 

p = x 0 + n(t) 

and z = sgn (p) (2.4.11) 


We can see that if x n be deterministic and x =0, because 
the probabilities of n(t) being less than and greater than 
zero, are equal, therefore p shall be (+ve) or (-ve) with 
equal probability. This implies that z is +1 or -1 with 
equal probability or its mean shall indeed be zero which is 
the value of x Q in this case. If x Q be +ve (~ve), the 
tendency of z will be to be +1 (-1 ) a larger number of times 
than ~l(+l). Avers. ging z over a 3.arge number of n(t) samples, 
will yield some estimate of x Q . 


A digital filter may be given by the difference equation 


y. 


TS 

z 

i=o 


a . u, . + 
i Ic-i 


M 

Z 

3=1 


V*- 


(2.4.12) 


where u^ is the input and y^ the output. Consider the 
formulation 

N _A__ 

y k = s « n [ Z a i U k-i + 2_ Vk-j + (2-4-13) 

i=o 3=1 

where n is a noise process with density as in (2.4.2), 
stationary , white, and independent between samples. Then 


by equation (2.4.10) 
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J3 


N M 

( y k )= 2; a iVi + 21 b j E( W 

i=o 3=1 


(2.4.14) 


whore is assumed deterministic. Equations (2.4.13) and 

(2.4.14) suggest a filter design, the output of which aft or 
averaging many samples yields an estimate of the filtered 
u^.. This is the quantized digital filter obtained from the 
linear or unquantized difference equation given by eqn, 
(2.4.12). The output y^ is followed by an averager, either 
an RC averager or a digital counter. The quantizer] filter 
obtained from the following difference equation 


y k = u k + Vk-, + b 2 y k-2 

is illustrated in Pig. (2.4.1). 


(2.4.15) 


Therefore the output of the quantized digital filter is 
an estimate of the true digital filter output. The output 
power spectral density is found by z -transforming the discrete 
ACP R (m) of the output. 


H(z ) 2 = 



1 - . z'~3 

3 3 


(2 .4.16) 


is the ratio of the output and input spectral densities 
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2 tit shift register 


Figs 2.4.U Border coarse-samplbd-mta filter 
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Finite Averaging Errors ; Since infinite time is not 
available for integration, approximate methods such as the 
RC averager ( a digital counter) must be used, let y be 
scaled and shifted such that 0< y <^1 and E(y) = p^. Since 
y is ergodic y = 1 for p^ fraction of the time and 

y=0 for 1~P Q fraction of the time. Since the dither is 
independent between samples, the auto-correlation of y is 



( 


= P 0 + 


(Po-Po)d' 


M v 
T } 



|<t 

)'t)>T 


(2.4.17) 


T being the sample and hold interval. 


The variance of the output of the averager is given 


by 


a 


v 


(P 0 -p2) Cl- . (1 - e - T /* C )] 


(2.4.18) 




T 

2RC 



(2.4.19) 


It shall be shown in Chapter 3 , that the output variance 

may be decreased by a change in the structure of the quantized 
filter, using a digital counter as the averager. 



CHAPTER 3 


DEVELOPMENT OP AN N-BIT FEEDBACK COARSE-SAMPLED-DATA PE L TER 

In this chapter the statistics of the output of first 
and second order linear digital filters are evaluated (Sec 3.1) 
Karlin's coarse - sampled - ^ a ta filter (Sec. 2.4) incorporating 
a digital counter averager in place of the RC averager is 
discussed in Sec. 3.2. The coarse - sampled-data filter is 
modified to yield the N-hit feedback coarse- sampled-data 
filter, discussed in Sec. 3.3, the output statistics of which 
can be made to approximate closely those of the output of the 
appropriate linear digital filter. 

3.1 The Linear Digital filters 

A discrete time system is an algorithm that converts 
the input sequence u(nT) into another sequence (the output 
y(nT), the two sequences being related by the operator 0 

y(nT) = 0 [u(nT) ] (3.1.1) 

A linear time invariant system is characterized by its 
impulse response h(n) [l,pp. 13-1 6]. The response to u(n) 
is given by the convolution relation 

Qpi 

y(nT) = 21 h(mI)u(n-raT) 

in.-** — 


(3.1 .2) 
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We shall consider causal, stable LTI systems. The input 
and output sequences to a LTI discrete system may be related by 
a constant coefficient Mth order difference equation of 
the form 


M _ M 

y(nT) = £ a k u(n~kT)+ h k y(n-kT) n ^ 0 (3.1.3) 

k=o k=1 


a . 

i 


^b^ characterize the system and b^ ^ 0. The transfer 


function of the system represented by (3.1.3) is 


H(z) 



M 

z 

k=o 


2.. a k z 


M 


1 


Z z 

k=1 


-k 


(3.1 .4) 


The frequency response of the system, H(e^ ) is given by 


n 




£ a.(e~ J ^ ) 

H(e^ u> )= li(a)J = 

1 - 


M 


(3.1.5) 


ZL V e ' j£ °) k 


k=1 


where (d is in radians. 


We shall consider the specific cases of the first and 
second order difference equation i.e. when M=1 and M=2 . The 
input to the system u(nT) may be either deterministic or 
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random. For each of the two cases the statistics of the 
output of the system shall he determined. 

3.1.1 The First Order Filter; 

The first order discrete time system is given Toy 
the difference equation 

y(kT)=a 0 u(kT)+a 1 u(k~7i) + b^ y(k-1I) (3.1.6) 

Consider the case when a^=o for simplicity, jb^ <1 for 
stability, (3.1.6) reduces to 

y (kl) = a Q u(kT)+h 1 y(kTfl) (3.1.7) 

let the input to the system tr u(nT) U(rT), U(rT) is the 
unit step function; by use of the recursive relationship 
of eqn . (3.1.7), it is easily shown that 
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■A time autocorrelation function R (m) may "be 

y 

the deterministic output y, m , given by 


defined for 


Ry(m) 


lim 1 ___ 

E+ T 1- y kT ^k+mT 

k=o 


(3.1 .11) 


_ lim 1 

Yi-'px' St- 


ic k k+m 

I < a o 2~ b 1 u k-u*'T^ a o 21 b l" U k+m3iT 
k=o r-o i=o 


(3.1 .12) 


lim 1 
h+ i 


K 0 k k+m . 

L a o t Z . 7 - b 1 u k-fT u k+S3iT 

c=o r=o i=o 


(3.1.13) 

t 

(b) The random input : Let u ^ be zero mean, white, stationary 
independent noise, specifically: 


S(u nT ) = b u =o all n 


B < u nT u 5Vl> = 6(m) 


(3.1.14) 


p(u nT’ u 5+5'T ) = p(u H+rf- p Kt ) 


Then the expected value of the output y, using the eqn. 


( 3 . 1 . 8 ) 


k 

E(y kI ) = ®[a 0 J_ ug--,, ] 


= a ol l | BCu irrT) 

r=o 


(3.1 .1 5a) 


(3.1 .15b) 



3.5 


The ensemble autocorrelation of y(kT) is 


R (k» k+m) = S(y, rr m ) 

i .y k+mT ) 


r, k lc+m , . 

a „ ? 7 Sf«t m Hr rj 

o 2y=o i^b 1 k~rT k+m-iT J 


o 0 k k+m , . 

R (k, k+m) = &/ 21 2 6(m+r-i)b^ 1 

* r=o i— o 1 


(3.1.16) 
(3.1 .17) 


The autocorrelation of y^ may also be derived as follows 


E(y (kT)y (k+mT) )=a^ E(u(kT)u(k+mT) )+a Q b^ [E(u(kT)y (E+m-1 T) 


+E(yfs:~1T ) 


u(k+mT) ) ]+b^ E(y(k-»1 T)y(k+m~1 T) ) 


(3.1.18) 


The cross correlation terms B (k— 1, k+m), R (k,k+m-*1 ) 

y,u x u,y' 


are first evaluated 


(i) By ;U (k-1, k+m) = B[y k _ i Uk+m ] 


m > -1 R „(k-1 = 0 

y 9 u 


(8.1.19) 


This is because y(3I>TT) is a function only of u('E'-TfT) and 
all the previous values of u, and is independent of the 
future values of the input. 


Ji y>u ( k- 1 ,k- 1 ) = B [y k-1 Uj..,] 


B ^ a o U k-1 +b 1 u k-1 ] 


a 0+0 
o u 


(3.1 .20) 
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m / -1 


R y>u (k-1 ,k+m) 


= E[y k _, « k+m ] 

= E ( a o u k- 1 1 y k-2 ^ u kfm 

= 0 + a o 4 t ,K-| 


(11) Vy (k ’ k+m - 1) = B K yk+m-i^ 

m <( 1 


m = 1 


^Vk+m-l ] = 0 

E[ VW1 J 


= a „ a 
o u 


m > 1 


E[ VW-i 


] = a„ <r 2 b”- 1 
o u 1 


Therefore , 

R y (k,k+m) = a 2 (l+b 2 +(b 2 ) 2 + ... + (b 2 ) k 


= a 2 b“ [(l+blj+b^+ ... + b^).o^] m> 0 
= a 2 o 2 [ 1+b 2 +b^ + ... + ^2(k+in)j b Jm| 

2lc‘+2 


.2, .4 


2k- 


( 


(; 


(: 


m=0 


Ry ( k , k+!0 ) = 


2 s r £ 

a o ^l 


1 -b 


. a 2 m 
u 


, . 2k+2 

= a 2 a 2 b m 1 

a 0 °u °i ; ^2 


m > O 


1~b 


a o a u b j ml (l-^ (k+m)+2 )(l-^)'' 1 m<0 


.1 .21 ) 

3.1.22) 

.1.23) 

.1.24) 

m < 0 

(3.1.25) 
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/ 


The input to the system is u nT U(jT), U(jT) being the 
unit step function. The process is necessarily nonstationary, 
regardless of the nature of u^. Hence the output of the 
system y nT is nonstationary , which fact is ratified 

by eqn. (3.1.25). When the system reaches steady state i.e. 


5 y(m) 


2 2 
a„ a 
o u 


with k very large, and v jb^ < 1 , eqn. (3.1.25) tends to 

0 

( 3.1 . 26 ) 


m 


1 -b 


1 


2 2 
a a 
__ o u 


bj m < JmJ ^ 1 

In steady state the power spectrum of the output is 


3 y M = Z V n) e 


gwm 


(3.1 .27) 


m= 


2 2 2 2 
a a a a 
o u , o 

— + 


oO 


1 


1 


1 


— S- 7 [*? e- jwm + b“ 

-b" m =1 1 1 


a 2 a ^ 00 

S ( w ) = j [ 1+2 I b“ cos£A»m ] 
d 1- b* m=1 1 


(3.1 .28) 


Thu value for S ( i0 ) obtained using the relation S i^) - 

y y 

H(z) H( z” ) / z _ e 3 w fora two sidee input and that obtained 
in eqn. (3.1.28) are equal. In steady state, the usual 
expression for S v ( Cf - > ) may be used. 

nJ 
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3.1.2 The Second Order Filters 

The second order linear system is defined hy the 
d iff erence equation 


y(kT) = a o u(kT)+ ^ y(k-lT) + b 2 y(k-2T) (3.1.29) 

The transfer function of the system is given by 

9 , 

H(z) = — (3.1.30) 

1 -b ^ z ~ bpZ 


The inverse-z transform of H(z) gives the impulse 
response h(nT) of the system. y(kf) is given by the 
convolution integral 

OQ 

y(k T) = /__ u(raT) h(F-mT) (3.1.31) 

m=o 

H(z) is given by eqn. (3.1.30) 


H(z) = a Q (1-p^" 1 )” 1 . (1-P 2 z” 1 )" 1 

b -» ( b 2 -t-4bJ 1 ' b -(b^+4b J ^ 
where p^ = — — , P 2 = — — ~ (3.1.32) 

H(z) = a Q ( 1 +p 1 z"" 1 +p 2 z~ 2 +p^z"" 5 +. . . ) ( 1+ppz"" 1 +p 2 z"' 2 +p 2 z“’ . .) 

&0 21 . 

= a |l+ J- z " n t Z- Pt Pp"’ 1 ]jf (3.1.33) 

1 n=i i=o J 

Hence h(nT) = 0 n < 0 

i n-i . n 

= a Q 2_ p 1 P 2 n ^ 0 


(3.1 .34) 
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(a) The Deterministic Input ? The RES of eqn. (3.1.31) 
gives both the output of the system and its expected 
value, when u(kT) is deterministic. The time autocorrelation 


is given by Rfm) 

if 


By(m) 


lira 
K— ><=o 


lim 

K 


X 


jrpf JL y(hT) y (k+mT) 


K 




f?T L T. L h(iT)u(k-iT)h( jT)u(k+m-jT) 

lL ' r1 k=o i=o j=o 


oO 


= Z_ Z- h(iT)h(jT) ^rr -6 u(F3iT)u(k+m^jT) 

i=o j=o ' k=o 


(3.1.35) 


Now if the time autocorrelation function of u(kT) is 


lim 1 




u(kT) u(k+mT) 


V ffi) = r+T £ =0 

substituting this relation in (3.1.35) we obtain 


OO crO 

R (m) = L Z h(iT)h(oT) .R u (m-j+i) 
y i=o o =0 


(3.1 .36) 


(b) T he Random Input : to the system is n(nT) U(o’T), where 

u(nT) is defined by eqn. (3.1.14) and U(jT) is the unit step 
function. Prom eqn. (3.1*31) it is deduced that 
eo 


E(y(kT) )= E[ ZL u(mT)h( (k-mT) ] 


(3.1.37) 


m=o 


OO 

Y E[u(mT) ].Qi(kEmT)J = 0 


m=o 


(3.1 .38) 
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The autocorrelation of y(kT) is defined as 

R y (k,k+m) = E[ y (kT)y (k+mT) ] (3.1.39) 

<X> 09 

= L 2- h(E^T)h(£fS^T)a 2 6(n- j ) (3.1.40) 

n=o 5=0 u 


oO 

= a 2 <L_ k ( k~nf ) h ( k+m-nT ) 
2 n=o 


(3.1 .41) 


Obtaining the expression for the nonsta tionp.ry R (k,k+m) 

y 

by using eqns. (3.1.41) and (3.1.34) setting k-v<*> f or steady 
state conditions and obtaining the DET of the stationary 
R (m) is unnecessary as the relation 

J 


s y( w )' 


S y (z) 


__ <4 H(z) H < z "b 

z © 


iOW 

z=e J 


(3.1 .42) 


to obtain the power spectrum for a two sided input yield 
the same result. Therefore 




2 2 
a a 
u o 


(l-b^"- b 2 e^ 2 f °)(l-b 1 e^~ b 2 e^ ) 

(3.1.43) 


2 o 2 

o * a 
u o 


1+b 2 +b 2 -2 (b^+b 1 b 2 ) cosiA' -2b 2 cos 2<u> 


(3.1.44) 


The autocorrelation function is given by the inverse~z 


transform of S (z) 
«/ 


Ry(niT) = ~y O S y ( z ) . z km1 dz 


(3.1.45) 
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For stable H(z), all its poles lie within, the unit circle 
3 2 Tif T 

z = e ^ 3 (z) exists on the unit circle and 

R (ml) is given by 

i/ 


= T 


2T 


2 

E( z=e^ 2n ^' 2 ) j . exp (jitfTk). df (3.1.46) 


TT 


The second order difference equation may be simplified by 
setting b^=0, in which case the recursive relationship is 

y(kT) = a Q u(kT) + b 2 y(kl2T) (3.1.47) 

The transfer function of the system is 


H(z) = — 


( 1 -p 1 z” 1 ) ( 1 -P 2 1 ) 

P 1 = ft>2 » P2 = “V b 2 


(3.1.48) 


The steady state power spectrum of the output is 


S y (to) = S y (z) 


z=e* 


! OJ 


= o 2 H(z) H( z” 1 ); 
u x ' v U 


z=e^ 


60 



(10 ) 



a 


2 

o_ 

2b2COs2 < ’> 3 


(3.1 .49) 


< ; * ’ '\NPim 
Ct. • 1 i ‘Jfi A Rif 

mzi 


Ns*. *r ,; k 
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Using eqn. (3.1*47), y(kT) may Toe written in terms of the 
input vp lues (u(iT), i=O f l f ...k), k = 2n+1 or k=2n, 
as follows? 

y (kT)= a 0 u(kT)+a 0 b 2 u(E^2’T)+ . . .+ a 0 p|u(kl2rf) 

+ ... + u(o) for even k (3.1.50a) 

= a 0 u(kT)+a 0 b 2 u(k32’T)4 . . .+a o Pp u(F-^rT) 

+ ... + p^ 11 u( 1 ) for odd k (3.1.50P) 

Thus y(kT), k is odd (even), is a weighted sum of 
the odd (even) input values. 

Evaluation of the Autocorrelation function R ( k , k-t-m ) of 
the output y(kf) requires prior knowledge of the cross- 
correlation functions vis. E uy (k,k+m-2) and R yu (k-2 ,k+m) . 
Using eqn. (3.1.50) 


R„ Tr ( k , k+m-2 ) = E[u(kT)y(k+m-2T) ] 

U y y 


2 / n \ m~ "1 

= a a CP, 
o u' 2' 2 


0 m < 2,m= all odd (+ve) 

integers 

m= all even(+ve) integers 

(3.1 .51 ) 

By u (k-2 ,k+m)=E[y(k-2‘T)u(lc+mT) ) 

m>-2,m=odd -ve integers 


= 0 

= a o°u 'V-v- - 1 


m= all even(-ve) integers 


(3.1.52) 



;>. 1 0 


Now 

R y (k,k+m)=a^ E[u(kT)u(&ml) ]+a Q b 2 E[y (EI^)u(E*mT) ] 

+ a Q TD 2 E [ u ( kl ) y ( k+m'~2 T ) ■ +b p E [ y ( k-2 T ) y ( F+in~2"T" ) ] 


(3.1.53) 

Substituting (3.1.51) and (3.1.52) in the recursive eqn. 
(3.1*53), for k=2n+i or k=2n and k+m=2r or k+m=2r+l 


Ry(k,k+m)= a^ (l+b 2 +b 2 +. 


2 2 r 

a o °u C 


..+(l=l) n ) 


m=0 


1 -b 


2n+2 


(3.1.54a) 


1-bJ 


a 


o b 2 * a o c7 u l3 2 m/ 2 " -1 ^ 1 +b 2 +b^+ . . .+ (b j; ) n ] 


a 2 a 2 „ ”/2 1±2 

0 u 2 1-b 2 


2 2 
2.n+2 


m 2 ,4,5, • . 
(3.1.54b) 


a o b 2 °u* b 2 ;mi/2 ” 1 ^ 1+b 2 +b 2 + 


..(h 2 ) r ] 


a o a u* b 2 lm| /2 C 


1-b 


2r+2 


1-bp 


= 0 jmj = 1 , 3 , 5 ,.. 


ra — -2 , 4 , , 

(3.1.54c) 
(3.1 .54d) 


In steady state conditions when k is large, the Autocorrelation 
is stationary i.e. 
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R y( m ) = R y( k » k+ m) 


„ 2 _2 
a a 
o u 


i-b| 

a 2 o 2 
o u 




m = 0 

b H/2 
2 


2 , 4 , 6 , 8 , . . . 


(3.1 .55) 


= 0 elsewhere 

3.2 The Coarse-Sampled-Data Filter: 

In (Chap. 2.4), the basic coarse-sampled-data filter 
using an RC averager, was studied. Here we study the coarse" 
sampled "data filter using a digital counter averager for 
comparison with the linear digital filter and for the 
subsequent comparison of its output with the output of its 
modification. 


3.2.1 The First Order Co arse-samp led -data Filters 

The difference equation characterising the first 
order linear digital filter is 


y ( IT ) = a Q u(lT) + b^y (1-1 T) (3.2.1) 

The filter is replaced by the coarse- sampled -data filter 
which serves to reduce the complexity of the hardware 
realisation of the filter. The relation between the input 
u(IT) and the output y(lT) of the coarse- samp led -data filter 
is given by the equations 
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z(N.l+k) = vSgn[a o u(lT)+n(Nl+k)+b^ z(Nl+k-1 )'] 


y(iT) 


1 

f 


N 

T zOsri+k) 

k=l 


(3.2.2a) 

(3.2.2b) 


A schematic diagram of the filter is shown in Pig. (3.2.1). 
Referring to the figure, let u(lT), the input to the coarse - 
sampled -data filter, be defined as in eqn. (3.1.14). The 
input and output sampling periods of the coarse-sampled - 
data filter are T secs. T should be chosen such that it 
is commensurate with the Efyquist rate of the input. The 
input should also be effectively constant over the sampling 
period T. The output of the ZOH is 


u(10.+k)= u(Nl+kT ! ) = u(lT) for 1 ^ k<£ N (3.2.3) 

The dithering noise n(Nl+k) added is such that it is 
uniformly distributed in the range (-1,1), independent 
between samples, and white. It is normalized, so that 


C a o max + | b l| 4 1 

(5.2.4) 

and [a 0 u(lT)] mln - |t,j * -1 

The _ output of the comparator or sign detector is 
+ 1 (-1) as its input, viz. a o u(lT)+n(Fl+E )+b^ z(3Tl-t-K~1 ) , is 
greater than (less than) zero. The delay of the feed 

back register is T', which is the period of the dither 



tt(lT) 
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n(Nl-hk). The averager is a digital counter that is reset 

to zero every IT secs, 1=0,1,... It forms the weighted 

sum J z(Kl+k') ? upcounting (down counting) by one 

** k=1 

as z(Nl+K) is +l(-l), effectively averaging out the effect 
of the added dithering noise n(Fl+k). The initial value of 
the delay line, z(~N+N), (in this cs.se it is a single 
element corresponding to T’) is +1 with equal probability. 

Eqn. (3.2.2) gives the input-output relationship of 
the coarse -sampled -data filter. The statistics of the 
output y (IT) are evaluated for 1=0, 1,2,.*. for the case when 
the input u(lT) is deterministic and random. 

(a) The Deterministic Input ; The range of the deterministic 
input to the system u(nT) is such that eqn. (3.2.4) holds. 

The output y ( IT ) is given by eqn. (3.2.2). 

(i) The probability of z(ET-i-k): The single element z(Nl+k-1 ) 
is initialised at l=o and k=1 , so that the probability 
of the initial value z(o)=z(N~N) being +1 or -1 is 
half i.e. 

P z (1) =1=P Z (-1) 0.2.5) 

o o 

From eqn. (3.2.2a), for 0, k=1 , 2 , . . . ,34, 

z(i\Ll+k)=1 ■=» a u(lT)+n(H'l+k)+h 1 z(Fl+k~1 ) y 0 

-> n(Nl+k) >-e 0 u(lT)-b 1 z(ia+k-1 ) (3.2.6) 



3.18 


The conditional probability p I (1 | z(Nl+k~l) 

^l+k f ^Sl+k -1 ( 

is given by 

Pq, Ji+k I 2Nl+k-1 ( 1 1 z(N1+IL " 1 ) )=p[n(ITl+K) > -a Q u ( IT ) -b 1 z ( Nl+k-. 1 ) 


/p(n) .dn 

-a 0 u(lT)-b z(jri+k- 1 ) 
1 +a Q u(lT)+b 1 z(FL 4 -k~ 1 ) 


(3.2.7) 

(3.2.8) 

(3.2.9) 


Therefore 
Pz Kl+k j z Nl+k- 


(-ij z(k T l+k~ 1 ) : 


1 -a 0 u(lT)-b 1 z(Nl+k -1 ) 


( 3 . 2 . 10 ) 


Since z(lTl+k -1 ) = + 1 , the four conditional densities 
may be evaluated from eqns. ( 3 . 2 . 9 ), ( 3 - 2 . 10 ). 


P, 


m+k 


d)= i 


P, 


Z N 1 +k -1 ^ T l+k{ Nl+k -1 


( 1 J z ( Nl+k- 


■1 ))fP 


z 


Nl+k -1 


(z(Nl+k-l ))] 


( 3 . 2.11 ) 


1 +a u(lT)+b, 1 +a rt u(lT)-b, 


lTl+k-1 


( 1 ) 


[P 


z 


’Fl+k -1 


(-1 ) ] 


z Nl+k 


( 1 ) « 


1+a o u(lT)-b 1 


+ b 1 P, 


m+k-i 


(D 


( 3 . 2 . 12 a) 
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Prom the recursive relationship of eqn. (3.2.12a) and from 
the initialisation z(~N+N)= +1 with equal probability , 
the probability of z(!Tl+k) may be determined. Similarly 


z,, 


(- 1 ) 


Nl+k 


1 -a u ( IT ) -b 

- — L + "h 

2 1 


m+k-1 


(- 1 ) 


(3.2.12b) 


(ii) The Expected value of y(lT) s 

y(lT) is a function of both the input u(lT) and the added 
dither n(El+k) as in eqn. (3.2.2). 

y (IT) = A 7 z(Nl+k) 
k="l 

A 1 I 

E(y (IT)) =1 7 E[z(Nl+k)] (3.2.13) 

^ k=1 

From eqn. (3.2.2a), 

E(z(El+k))-E[sgn(a o a(lT)+n(El+k)+b 1 z(Nl+k-1 ) ] (3.2.14) 

y r 

= L ■ [ j [sgn(a u(lT)+n(Nl+k)+b 1 z(ll+lc-l ) ) ] . 

ITl+k-l J n ° 1 

p (n) dn] . p(z(Nl+k~1 ) ) (3.2.15) 

Invoking the results shown in (Chap. 2 -.3), (3.2.14) reduces to 
E[z(El+k)]=S[a o u(lT)+b 1 z(Nl+k-1 )] 

=a Q u(lT)+ b 1 Ef z(El+k-1 ) ] 

=a Q u(lT)[l+b 1 +b^+ ...+ b^” 1 ] + 


(3.2.16) 
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b^[a 0 u(T^lT) (l+b 1 +b ^+..-.+^”‘ 1 )+a 0 u(l- 2 T) .b^( 1 +b.j+b^t- . . .b ^” 1 ) 
+ . . .+ a o u(l~rT) b^ r “’^ ( 1 +b^+b^+ . . .b'*^ ) 


+ a Q u(oT) bf 1 " 1 ) (l+b i) +b^+ ... b ^" 1 


)] 


,J£ ,N\ 1 

a „ TTh 1 - + a o ^ TTE7 ' I. ^ (r ' 1> -u(i^T) 

(3.2.17) 


r =1 


Substituting (3.2.17) in (3.2.13) we obtain 


U 


A * 

E(y (IT) ) = l 2_ E(z(Nl+k)) 


k=l 


. N a u(lT) - a u(lT) 

U- ° 


N l 1 -b 


1 


1 -b 


1 


IT 

I 

k =1 


, k , „ 
b 4 + a 


( 1 -b^ ) 

o ( 1 ~b“T 


[ l -t,N ( r- 1 ) u (JZrT) ] [ £ ] ] 


r =1 1 


k =1 


a 0 u(lT) - b^uCLT) ( 1 -b^) a^ 


1 -b 


4- 


1 ~b 


1 

IT 


K ( 1 — b 4j ) ‘ 


N 


) 2 . f b 1 ?^" 1 } u(I=?T) 3 (3.2.18) 


r=1 


For effective averaging, the length 1 of the counter must be 

with 

very large. Theref ore/jT->® , from (3.2.18) we obtain 


E(y(lT)) - lim 1 


IT 


^ ¥ k 5 1 3(z(F1+k)) 


a p u(lT) 

1-b 4 


(3.2.19) 
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By comparing eq. (3.2.19) and eq. (3.1.9), it is seen that 
the expected value of the output of the coarse-sampled- data 
filter does not approximate the output of the filter it is 
required to replace. 

(ii) The Time Autocorrelation of y(lT): 


It is required to check the matching of the time 
autocorrelation functions R (m), R<\(m) of the outputs of the 

y y 

linear digital and the coarse -sampled -data filters respectively 
let R*(m) he defined as follows; 


R y 


(m) = 

1 

K+1 

E 

z 

k=o 

y(kT) y ( k+mT ) 

(3.2.20) 

_ lim 

1 

K+1 

£ 

£ ■ 

1 

2 

R^ 

R 

V 

.L 

i=l 

R 

L 

3 = 1 

z ( Rk+i ) z ( Rk+'m+ j ) 







(3.2.21 ) 

li 

bs{ H 
'vj, F* 

1 

ST 

K 

L 

k=o 

1 

— 7 

R^ 

N 

i=l 

R 

V 

/ 

3 = 1 

Sgn(a Q u(kT)+ 

n(Rk+i)+b^ 

z(Rk+i 

-D). 

Sgn(a Q 

u ( k+mT ) +n ( Rk+m+ J) 


+h 1 z(Nk+m+j-1 )) (3.2.22) 


Row since y(k) is a function of the added dither, the 
expected value of R (m) is shown to be 

t y 


E(P^.(m)) 


_ lim 1 
K+ 1 


K 

V 

k=o 


— ? i- 

R^ i=1 


R 

E ( z ( Rk+i ) . z ( Rk+m'+ j )J 
j=1 

(3.2,23) 
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When. m=o, 
E(Ra(o))= 


for a finite N,E[Ra(jh)] reduces to 


lim 1 
K+ 1 


K 

T 


i 


E 


k=o e 


[ 7 E(z^(Ek+i)) 


i=1 


lim 

K 


4- 


E 

A 


E 

t 

3=1 


• L f j 


1 

K+1 



E ( z ( Ek+i ) z ( Ek+ j ) 


1 

~2 

E 


E E 

[E+ 7 ) 3(z(Ek+i)* 

1=1 3=1 

i^3 


z ( EK+ j ) ) ] (3.2.24) 


Using eqn. (3.2.17) and the results derived in (Chap. 2.3), 
(3.2.24) reduces to the recursive equation: 


E(7*(o) 


lim 1 
E-**> E+1 


7 -U [(E 2 -E)a 2 u 2 (kl)+2a b (E-1 ) 
k=o $r ° ° 1 


( Ea u(kT) 

; PET” - a o u(M) * 


1-b 
1 -b 


E 

1 

2 

1 


1-^2 

+ a 0 ( L )* 


1~b 


7 ^E(r-~1 ) u <j 

r=1 1 J 


+ k? f. L B[z(Ek+i--1 ) z(Ek+j-»1 ) ]] (3.2.25) 

1=1 
IF 3 

In the limiting case, as E-fco , E(R^(k,k)) tends to 


lim 
E -?*-o 


S(Ra(o))= 


lim 


1 

A+ 1 


K 

L l 

k=o 


a 2 u 2 ( kT )-i-2a 2 b . 
o o 1 


u(kl) 

1~b 1 


lim ]_ 
E~»*> h 2" 


EE - 

7 7. E[z(Ek+i~1 )z(Ek+j-l ) ] ] 

1=1 3=1 

1^3 


(3.2.26) 
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Comparing Eqn. (3.2.26) with Eqn. (3.1.13)1 _ >i im E(Ra( k,k) ) 

) IB— O rJ oc> y 

as given by (3.2.26) is seen to be greater than RA(k,k) 
evaluated for the linear digital filter. Similarly 
for m^o, from eqn, (3.2.23) and using (3.2.17) 


E <y ”>>=££. ssr k l ^ ZT D(s(fci)z(*Mi)) 


K 


1 


U IT 


liTn . K . 9 o 8 

E+T I- T rra^u(kT)u(k + mT) + N a Q b 1 u(k+mT) . [ ^ 


N ' 

!( z(Fk:+i-1 ) )+E a b,u(kT) > E( z ( Nk+m+ i - 1 ) ) 

0 1 T=i 


? N 8 

+ hf 7 J_ S( z(lTk+i~1 ) z(ilk+m+ 3~1 ) ) ] 
1 3=1 j=1 


(3.2.27) 


= g~- J l-g [iT^a^u ( k'P ) u ( k+m'T ) +F a^uCk+mT), 

k=o l\f ’ 

r 8 ? 

^ E ( z ( Nk- 1 +R ) ) + jT E( z(Nk+i~1 ) )j + Ea o b ^ u(kT). 

_Ji_ ' * 

E ( z ( Kk+m- 1 +U ) )+ E( z(Nk+m+o-1 ) )] + b^ 


0 8 8 

d <r 

L 


I 

i=1 r=1 


E( z(ilk+i-1 ) z(Hk+ra+o-1 ) ) ] 


(3.2.28) 
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_ lim l 


K 


“*> g+T Zr 7 ? [iT 2 a2u(kT)uac + mT) + N a o lD uCFSt), 


k=o E‘ 


, 1-b? „ 1~b N 

[(a o u(k-,T). — J-+a o b® . T 


5-. b« r - ,) u(— rT )f 

1 r=1 1 J 


+ {^kW-~ a -f 


a^u(kT) b 1 ~b^ 1 ~b r | Id 1 -h 1 ^ 

b~ * fTb’ + a o l~b 1 * ~1 -b,' 


k 

Z\ 


£ b 1 j r(r ” l) u(k-rT)j ]+Fa Q b 1 u(kT)[^ a o u(k+mTiT) . 


1-b 


N 


1 -b 


1 


+ a b 


U 1 -b .j k+m- 1 


o“l 1-b 


1 at/-. 1 \ - / a U 

^ b*^ '” 1 u(k+m-f-rT)j H-| (N~1 ) —2-j 


a u ( k+mT ) 


1 


a o u( k +n ,T) b,-bf 1-b* b,-b* k±m 1(r _ n 

+ a„ 5- . " ~ 2- D - 


1-b 


1 


1-b 


1 0 ^1 

11 11 

7 

3^ 


^1 r=1 “1 


u(k+m-rT) •; ]+b. > 7 E(z(Hk+i-l ) z(3Ik+m+ j-1 ) ) ] 

J 1 i=1 j=1 

(3.2.29) 


In the limit, as , E [k^(m) ] m ^. 0 tends to 


S( ~^K)h = T,*, dr I C^utM )u(k+mT)+ -fV” • 


lim 


K 


2a 2 b 


& 1 


u(ltT)u(k+mT)+b 


2 lim 

1 t 2 

k 


k=o 
I H 

7 y E(z(Nk+i-l) 
i=1 3=1 


z ( Nk+m+ 3 - 1 ) ) . 


(3.2.30) 
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Eqn. (3.2.30) is a recursive equation* comparing it with 
(3.1.13) for m^o , we see it yields extraneous terms 
apart from those encountered in eqn. (3.1.13). 

(b) The Random Inputs 

The random input u(lT) to the system, witn density 
function p (u) , is defined by eqn. (3.1.14) and its range 
satisfies eqn. (3.2.4). Eqn. (3.2.2) defines the input - 
output relationship of the filter. The statistics of the 
output may be evaluated as in the case when the input 
is deterministic. 

(i) The conditional probability of z(El+k) ; z(Nl+k), given by 

eqn. (3.2.2a) is a function of both z(Nl+k-l) and u(lT). 

The probability p„ (l) and p z (-1 ) are both equal to half. 

^o o 

Therefore the probability of z(Nl+k), conditioned on u(lT) 
and z(El+k-»l ) , may be evaluated. 

zUl+E) = Sgn(0 0 Lt(lT) + b 1 z(Nl+K-l)+ n(El+k)) 

Therefore, 

p„ . „ ( 1 1 z ( Nl+k- 1 ) , u ( IT ) ) 

z l'Tl+k l ^El+k ™ i , U (1T) I 

1+a o u(lT)+b 1 z(El+k-.l ) 


2 


(3 .2 .3 la ) 
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P„ U (-1 |z(Hl+k-l),u(lT)) 

& i\ 


m+kj Fl+k-1 j'a(lT) 


1 ~a Q u ( IT ) -b z ( Fl+k- 1 ) 


(3.2.31b) 


(ii) The Expected value of y(lT)s 

i N 

E(y(lT))=I 7 E ( z ( Hl+k ) ) 
k=1 

Expected value of z(FH-k) is given by 


E(Z(Nl+k) )=E[sgn(a o u(lT)+n(ITl+k)+b z(Nl+k-1 ) ] 
=E[a Q u(lT)+b z(Fl+k~1 ) ] 
=a 0 E(u(lT))+b 1 E ( z ( Fl+k~ 1 ) ) 


(3.2.32) 


Ey analogy with eqn. (3.2.17), (3.2.32') reduces to 

1-b* k (l-b* T ) 1 

E(z(Il+k))= a Q E(u(lT))+a 0 b 1 -p~ . L 


b E(r~1 ) B ( u ( 1 „ rT ) )] 


(3.2.33) 


Therefore, 

B(y(n))= f 


i 11 v 1-b? 

[a o tv; • Vh tv- 


b 


u 


1 

<c 

L. 

r=1 


N(r~1 ) 
1 




an an 

o *u e ‘u 


1-b. 


1-b 1 * F 


( i _b^5 ) a n 
1 >, v 1 ' , o 'u 

* U > 'j"U ^ ... , r „ i -f. 


1 1-b 


1 


N 

N 


1 1 1 

rl±L ( } Y> . b i±L ] 

L 1-b, ^ °1 ; 1 1-b, J 


(3.2.34) 



3.27 


In the limit, as IT -»<«>, B(y(lT)) tends to 


lim n/ * / ^ rn ^^ a o% 


N— 


E(y (IT) ) 


1-b. 


(3.2.35) 


Therefore, when IT tends to infinity, E(y(lT)) agrees with 
E(y(lT)), ( eqn . 3.1.14b) if r\ =0 . 


'u 


( iii) The Ensemble Autocorrelation function of y(lT): 

The autocorrelation f inaction of y(lT) is given by 


R*.(k,k+m)=c.[y( kT)y (k+m'T) ] 


(3.2.36) 


F F 


-4r > 5 • E (s (Fk+i )z (Fk+m+j ) ) 

sr i=1 j=T 


Using eqn. (3.2.2a) 

. IT F 

— ■ L— v 

.2 . 

3 


Ra (k,k+m)= -5- > £ E[sgn(a u(kT)+n(Nk+i)+b 1 Z(Fk+i~1 )). 

y F^ i=1 i = 1 0 1 


sgn(a Q u(k+mT)+n(I v Tk+m+j )+b^ (Uk+m+j-l ) ) ] (3.2.37) 


For m=o 


F ? F F 


R*(k,k)= -4>- [ L B(z(Fk+i) ) + Z L. B[sgn(a u(kT)+n(Fk+i) 

.y i=i 3=1 

i^3 


IT i=1 


+b 1 Z(Fk+i~1 ) ) . sgn(a 0 u(kT)+n(Fk+ 3 )+b^ Z(Fk+3~1 ) ) ] 
, F F 

"V 7" H E[(a u(kT)+b z(Fki-i-1 ) ) (a u(kT) 

IT i=1 3=1 


+b 1 z(Fk+j-1 ) ) ] 


(3,2.38) 
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= ~ 2 )a o 'b 1 £ E(u(kT)z(Nk+3-1 ) )+(E-1 ) . 

N 9 F N 

L~ E(u(kT)z(Bk+i-l ) )+"bf ) } E( z(Nk+i-1 ) z(Nk+ 3-1 ) ) ] 

i=1 i‘=1 3=1 

ir3 

(3.2.39) 

It is required to evaluate the cross-correlation function 

\ fZ (kT,rk+I'^Tl' )=E[u(kT)z(Nk+ 3 -l)] 3 = 1,2... ,N (3.2.40) 

for 3=1 

E[u(kT)z(Mk+3-l )]=E[u(kT)z(N3FT+N) ] (3.2.41) 

From the structure of the filter, u(kT) and z ( NE^f+N ) 
are independent^ the latter being a function of u(k^Tl')> 
u(k~2T) ,..u(oT) , of which u(kT) is independ ent , By definition 
E(u(kT))=0 hence (3.2.41) reduces to 

B[u(kT)ZOsflET+N) ] = B(u(kT)).E[Z(H2TT+N))]=0 (3.2.42) 

for 2 4 

E[u(kT) z(Nk+3-1 ) ]=E[u(kT)sgn(a Q u(kl)+n(Nk+3~i )+b ^ z(Nk+ j-2 ) ) ] 

=E[u(kT) (a o u(kT)+T3 1 z(Kk+3-2) ] 

=a o 0 u + " D 1 ^fu(kl) . z(Kk+ j-2 ) ] 

=a o °u Cl+l3 1 +b i + - * * +lD £ 2 ] 

1 ~tp "" ^ 

= a o <£• ""T-Fj" " 2 4jO T (3.2,43) 



Substituting eqn. (3.2.43) in eqn . (3.2.39) we obtain 


*5 r 9 00 q 1 -'"b 

V kyk) = ,7 t8+(2r ~ N) * a o v 2{H -^Vi a o a u* T^b 


2 _2 


j-,1 


N‘ 


+'k> 1 ' J 71 z(Nk+i-1 ) z(Hk+j-1 ) ] ] 

i=1 j=1 
i^3 


d=2 


f f 


(3.2.44) 


F 


' [H+(» 2 -«)a202 + 2( H _ 1)a 2 bia 2[2rI _ FlF— ] 


f 


‘o 1 u 1 -b 


1 { 1 —t> i ) ‘ 


H IT 


+ bT L B[z(]ffk+i~l)z(Mk+ 3-1 )]] 

i=1 j=1 
1^3 

In the limiting case, when F-jt-o, R k( k , k ) tends to 

7" 


(3.2.45) 


lim 


If-?* E y (k,t)= ®o‘4 + K™ ^ ^ E[z(Hk+i-l)z(Jtt+3-1)] + 


11 i7 ^ (3.2.46) 

Comparing eqn. (3.2.46) with eqn. (3.1.17) for m=o, we see that 


2a o ff uV’-V' 


(3.2.46) contains other terms, apart from those contained 
in eqn. (3.1 .17). 


For m^o:- 

R/'(k,k+m)= ijy 7 7 E[sgn(a u(kT)+n(Nk+i)+b 1 z(Fk+i~1 ) 

y F i=1 j-1 


F 


s gn ( a. Q u ( k f mT ) +n ( FE+m+ j )+b^ z(Fk+m+j-~1 ) ) ] 
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Therefore n(lTk+i) and n(TTk+m+ 3 ) are independent (m^o), hence 

IT IT 

R.l(k ? k+Ki) = ? 2— 13[a^u(kT)u(IE?mT)+a b u ( k+'m'T ) z ( Nk+ i- 1 ) 

y N i=1 j = 1 ° 01 

+a Q b 1 u(kT)z(]\Tk : rm+ 3 -.l )+b^ z(Hk+i-1 ) z(Fkt3H-3~1 ) ] (3.2.48) 


N 


IT 


IT' 


2 [ a Q b 1 *^* X B(u(k+mT)z(Nk+i-l ))+Na Q b 1 £ E(u(kf) 


0 = 1 


IT 3T 


z(lTk+m+ 3~1 )+b T > E( z(3Tk-fi-1 ) z(M-c+m-i- 3 ~ 1 ) ) ] 

1 i =1 3=1 

(3.2.49) 

To evaluate Ra (k,k+m), therefore, , the cross-correlation 

V 

functions E(u(k+-"raT) z(JTk+i~1 ) , E(u(kT) z(Nk+m+ 3 - 1 ) , i=1 , . . . ,F, 
3 = 1,..., 3T need to be evelus.ted. 

E [ u (iE+ia 'I 1 ) z ( ITkt- 1-1 ) j , i= 1 , 2 , . . . , IT; m^o 


B[u(k+mT) z(lTk+i-1 ) ]= 0 m 'ty 1 , for all i 


a bf .«¥< N" 1 ) . 
o 1 u 1 1 -b 


m 4% -1 9 for all i 

E[u(kT) z(Ek+m4-,j-1 ) ] , j = 1 ,2 , . . . ,H m^o 
E[u(kT)z(lTk+m+3-1 ) ]=o m k -1, all j 


(3.2.50) 


i ~b w 

=a o 2 b£ .b^ E '" 1 ^ T~ yT * m -^1> a11 0 
o u 1 1 1 -b ^ 


(3.2.51) 
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Substituting (3.2.50) 
iiA(k t k+m) = Xj [a b N. 

y ^ u i 


+ b 


2 

1 


IT N 

I Z. 


i=1 3=1 


and (3.2.51) in (3.2.49) we obtain 



E( z(Hk+i-1 )z(Nk+m+ j-l ) ) ] 


7 Ca 0 b 1 t,o u< (|m, ' 1> < 


1-b H 

1 1 n2 . *2 

~ } + b 1 


h T ¥. 

X 7- 

i=1 3=1 


i( z(Hk+i-1 ) z ( lTk+m+ j - 1 ))] 


(3.2.52) 


Eqn . (3.2.52) therefore is the recursive equation for 
evaluating RA(k ,k+m) m ^ Q . In the limit, as N-^oo 
RA(k»k+m)| o, it is seen from eqns . (3.2.46) and (3.2.52) 

that the autocorrelation function of the output of the coarse- 
sampled -data filter of the first order does not equal that of 
the output of the linear digital filter, even with infinite 
averaging time (H— s* oo ) 

3.2.2 The Second Order Coarse-sarapled-data kilter s 

A linear second order digital filter is given by the 
difference equation; 

y(lT) = a o u(lT)+b 1 y(l3TT)+b 2 y(I^2T) 
kor convenience, let b^=o. Hence y(kT) is given by 

y (IT) = a o u(lT)+b 2 y(I^2T) 


(3.2.53) 
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Kirlin's coarse sampled data filter replacing a linear 
second order digital filter is given by the equations. 

Z ( Nl+k ) =sgn ( a Q u ( IT ) +n ( Nl+k ) +b 2 z ( Nl+k-2 ),' (3.2.54a) 

a i K " 

y (IT) = ~ T z(Nl+k) . (3.2.54b) 

" k=i 

The input u(lT) is as defined in eqn. (3.1.14). The period 
of the dither n(Nl+k) is T' seconds, n(Nl+k) is uniformly 
distributed in' the range (- 1 , + 1 ) so that 

a u(lT) + }b_j 4 1 
o v 'max 1 2 ^ 

(3.2.55) 

a u(lT) . - ib 0 / v -1 

o 'mm 1 2 [ r 

p n (n) = ~ - 1 ^ n 4 1 (3.2.56) 

Tig. 3.2.2 shows a schematic diagram of the second order 
coarse-sampled-data filter. 

(a) The Deterministi c I nput s The deterministic input 

u(lT) is such that the eqn. (3.2.55) holds. The output of th 

coarse sampled data filter is given by eqn.s (3.2.54) 

(i) The probability of z(Hl+k ) i The initial values of 

z(Nl+k~l ) ond z(Nl+k~2) at l=o and k=1 are set such 
that the initial stored va3.ues 2(0), z ( — 1 ) are each 
+1 with equal probability and are mutually 
independent i.e. 
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p z ( 1 ^ “ p z ^' 1 ^ ~ I 
o o * 


p 2 (1) = p z (-1) 


1 

2 


(3.2.57) 


Using eqn. (3.2.54a) (5.2.55), the probability of z(FH-k) 
conditioned on z(Ul+k--2) is 


P 


z Ul+k| z i\fl+k-2 


P 


z 


Ul+k 


m+k-2 


1+a u ( IT )+b 0 z ( Ul+k-2 ) 
(1 lz(ITl+k~2) — = — — - — 


(3.2.58) 

1 ~a Q u ( IT ) ~b 2 z ( Nl+k-2 ) 

T 

(3.2.59) 


(-1 jz(Ul+k-2) = 


The probability of z(Ul+k), in the form of recursive 
equations is 


1+a u(rr)»K 

p (1 ) = 5 + b 2 P z 

z ITl+k z ^ z Hl+k-2 


( 1 ) 


(3.2.60) 


1 -a u(lT)-h 

> (-1 )= o~ + t P_ 

-Nl+k z ^ z Nl+k-2 


(- 1 ) 


(3.2.61) 


(iii) The expected value of y(lT)s 

Prom eqn. (3.2.54), the expected value of y(lT) is given by 

A i ^ 

B(y(lT) ) =4, l_ E(z(Nl+k)) 
iN k=1 


Using eqn. (3 *2. 54a) 
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E ( z ( Nl+lt )=E [ sgn ( a Q u ( If ) +n ( Nl+k ) +b 2 z ( lTl+k-2 ) ) ] 


=a Q u(lf )+bpE[z(Nl+k-2) ] 

k + 1 k- 1 

2 2 


1 ~b 


=a o u(!T). - ^ 


+b “ . a. 


• N 
1-"b 2 2 

o* ~T~b, 


( 3 . 2 . 62 ) 


1 

L 

r=1 


u(l-rf) (b^ 2 ) r "^ for odd kj even N 
k+1 


(a) 


k-1 


H+1 


1 -b p 2 1 -b 9 2 

-a Q u( IT) . 'fTb~ + b 2~ * a o T^b3T~ 


1 __ IM_ 

u(l~rT)(b 2 ) r ~ ' for odd k; odd IT (*>) 

r=1 ^ 


K « 
1-b^r 1 


ILi 
1 ~b„2 ' 


-o -n(lT) ^ _l v^/ 2 „ 2 

- C - 0 U(1TJ. + b 2 * a D * 1 _ b2 


7 u(T^FT).(b/ /2 ) r “ 1 

r=i ^ 

k I ^ 

1 ■'•6p 2 /p 

=a Q u(lT). +b 2 


for even k; even N(c) 

• E+1_ 

1-b 2 2 

.a . r~rr 

o l-b 2 


-L ___ I „ « 

7" u(l~rT) (b 0 " 2 ) ” for even k; odd E(d) 

r=1 2 

(3.2.63) 

Eor the two cases, (i) N is odd (ii) 1" is even E(y(lT)) is given 
by 
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B{y(lT))= 1. [ Z. 

k=i ,3,5. . .¥ 


E(z(Fl+k))+ ]T E( z(lfl+k) ) ]F odd (a) 
k=2 , 4, . . . ,F~1 


- ^[ L _ ®(z(lTl+k) )+ 22 E(z(Nl+k))] IT even (b) 


k=1 ,3, . . .F-1 k=2 , 4 , . . . , N 


(3,2.64) 


Therefore , 


a u(lT) a ku(lT) 


E(y(lT)) = 1 [-Vt- .F- 


F L 1~b, 

c 

jsr+i 


1-b 2 2 


(l--b 2 )‘ 
F+1 1 


N4- 1 

.(l+b 2 ~2b 2 2 )+ 


H-1 


r "1 Wi 


(l+b -2b 2 ) £ u(l-rT)(b ? T“ r”' 1 ] 

0 ( 1 -b 0 )^ 2 2 r=1 2 


odd N (a) 


£f, 

- 1 .u . W,_>,If/2>, - 1-b 2 2 


a u(lT) a b 0 u(lT) 

r* (i+b 2 )(i-b"^)+ a 0 


F L 1-b 


(l-b 2 )‘ 


(i-V 


F (r-ll 


( 1+b 9 ) ( 1 -b 9 N//2 ) J u(l»-rl)(lD 2 ] even F 


2 * 


(b) 


r=1 


(3.2.65) 


_ A 


In the limit as F-v.-jofor infinite averaging £(y (IT) ) tends to 


N-~><=o 


Ky(if) ) 


a o u(lT) 
1 -b 0 


for F either odd or even (3.2.66) 


Comparing the RHS of eqn. (3.2.66) with the o/p of the 
corresponding second order linear digital f ilter (3.1.50), 
it is seen that E(y(lT)) is not close to the desired 

value y(lT) . 
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(ii) The Time Autocorrelation of y(lT) : for the second 
order coarse sampled data filter is defined in a 
manner similar to that for the first order filter. 


R (m) 

y 


lim 1 
K+1 


£ y ( kT ) y ( k+mT ) 
k=o 


(3.2.67) 


lim . K . E E 

= K-eco K+7 k 4 0 ^ z(Rk+i)Z(zk+m+j) 

( 3 . 2 . 68 ) 

E(R (m))= - f 4 f f E(z(Ek+i)z(Ek+m+;i) ) 

y K+1 k ^ Q k 2 ^ ^ 

(3.2.69) 


Urn 1 J- 
'^ K+1 feo E 2 


K N 

7" 7- S[sgn(a u(kT)+n(Ek+i) 

i=1 3=1 


+ 'b2Z.(Rk+i-2) ) .sgn(a o u(k+mT)+n(Ek+m+3 )+b2z(Ek+m+3~2 ) ) ] 


(3.2.70) 

E ( R* ( M ) ) can he expressed in the form of recursive equations. 
Eor m=o 


E(R y (o))= 


lim 1 y 

K+ 1 /— 

k=o 


[N+(N 2 -l\f)a^u 2 (kT)+a o h 2 u(kT)(N-.1 ) 


IT E o E N 

£ E( Z(E*k+i-2 ) )+ J_ E(Z(Ek+j-2) )< +b‘l £. 2L 
i=1 3-1 1 i=1 3=1 


E(Z(Ek+3-2)Z(Ek+i-2) ) ] 


(3.2.71) 
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Depending on the nature of E, the appropriate two equations 
of equation (3.2.63) may he substituted in eqn. (3.2.71), 
to obtain E(R*(m)) by expanding the last term of eqn. (3.2.71) 
recursively. 


For : .From eqn. (3.2.70) for m^o. 


l, m i E . IT N 

E(Rf (m) ) = K 7 ~2 7 L S[(a u(kT)+b z(nE+i-2)) 

y iti k - 0 ^ j_^r} ^ =1 o * 


(a u(k+mT)+b 9 z(Nk+m+ j-2 ) ) ] 


lim 1 
E—jtoO E+ 1 


1 


L "Sr [E^a):u(kT)u(k+mT)+E a b 0 u(k+mT) 

TiT^-* O O 


k=o E 


E E 

7 E(z(Ek+i-2 ) )+u(kT) J E( z(EFhm+ j-2))+ 
i=T 3=1 

2 E E 

b 2 L 7E(z(Ik+i-2)z(Ek+m+j-2))] (3.2.72) 

i=1 3=1 

As E is odd or even, the appropriate substitutions may be 
made from (3.2.63) in eqn. (3.2.72) and the last term in 
eqn. (3.2.72) expanded recursively to give E(R*(m))« 

(b) The Random Input : to the second order coarse-sampled- 
data filter u(lT) is white, stationary and independent as 
described in eqn. (3.2.14). In addition, its range is such 
that eqn. (3.2.55) is satisfied. The statistics of the 
output y(lT) of this filter are derived thus: 
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(i) The conditional probability of z(Nl+K): The values 

of z(Ul+k-l), z(Ul+k-2) are initialized at l=o, k=1 such 
that z(o),z(-1 ) are +1 with equal probability i.e. eqn. 
(3.2.57) holds. Eqn. (3.2.54a) gives z(Ul+k) , a function of 
u(1T)j, n(Nl+k) and z( Ul+k-2 ) . Hence the probability of 
z(Nl+k) conditioned on both u(lT) and z(Ul+k-2) is given by 


'Nl+k 


1 +a u ( IT )+b 0 z (Hl+k-2 ) 

(1 j z(Ul+k-2),u(lT))= 2 _£ ■ 

'Hl+k-2, u( IT) ^ 


P z 

z Ul+k 


(3.2.73a) 

1-a u( IT) ~b 9 z (Hl+k-2) 

(-1 z(Hl+k-2),u(lT))= — 5-^ 

Hl+k-2, u( IT) ^ 

(3.2.73b) 


The unconditioned probability of z(Ul+k) may be obtained from 
its expected value, evaluated next. 

(ii) The Expectation of y(lT): Using eqn. (3.2.54) 

E(y(lT) = 1 E( z(Nl+k) ) (3.2.74) 

k=l 

E( z(Nl+k) )=E[sgn(a 0 u(lT)+n(Nl+k)+b 2 Z(Hl+k-2) ) ] 

= a Q p u +b 2 E[ z(Ul+k-2 ) ] (3.2.75) 

The result is as given in eqn. (3.2*63), u(lT) and u(l-rT) 
being replaced by rj^, the substitution made as before:- 
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•n aH ab 

B(y(lT))= ^ [- ^ 0 2 


n+i 


H L 1 -b 


2 ( 1 -b 2 ) 


S±i ^ 

• 2 .(l+lD 2 -2b ) +a 0 ‘ . ,2 

( 1~M 


ET+1 


( 1+b 2 — 2b 2 


1 


(K-l) (r-1 ) 


) I ^ 


] odd n 


r=1 


a F ab 


u 

F~ L- 


J 2 (l-b 2 ) 


°~ 2 ^.(l+b 2 )(l-b 2 N/2 )+a 


If 


‘4*1 


1-b, 


° <’-V 2 


i\T/o i n (r-1 ) 

(l+b ? )(l~b/ /2 ) 21 b„ “ ] even IT 

r=1 ^ 

(3.2.76) 


Lim 


a -n 

A. 1 


O U 


^ B(y(lT) = ft 


(3.2.77) 


If u(lT) is zero mean, RHS of (3.2.77) is zero, tallying 
with E(y(kT)) obtained from equation (3.1.50). But if 
?^o (3.2.77) is seen to be greater. 


Evaluation of probability of z(Hl+k);- 
Bet p (1 ) = P 

tti+k 


E(z)= p+ (-1 ) (1-p) 

p (i) = (3.2.78) 

Z B1+K 

Since E(z) is already available from eqn. (3.2.75) and 
(3.2.63), * p * may be evaluated. 
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(iii) The Ensemble Autocorrelation of y(lT) is given by 


B* ( k , k+m ) =E (y ( kT )y ( k+mT ) ) 
i N N 

= "T ? 7L- E(z(Ek+i)z(Nk+m+j) (3.2.79) 

E i=1 j = 1 


i E E 

R*(k,k) = -*• T T E(z(Ek+i) z(Ek+ 3 ) ) (3.2.80) 

7 E i% j=1 

M3 

1 E E 

= ^ [E+ 7 7 E(z(Nk+i)z(Nk+j) )] (3.2.81) 

fi i =1 3^1 

i^3 

1 J N 

= - 5 - [E+ > > B[sgn(a u(kT)+n(Ek+i)+b 0 z 

E i =1 3=1 0 ^ 

i^3 

(Ek+i-2 ) ) .Sgn(a o u(kT)+n(Ek+j )+b 2 z(Nk+3-2 ) ) ] 


= jjj [E+(E 2 ~E)a2a2 +2 a o b 2 (N>1 ) E(u(kT) 


0 E E - - 

z(Rk+i-2 ) )+b]l 7 7 E(z(Ek+i-2)z(Ek+3~2) )] 

^ i=1 3=T 

(3.2.82) 


For odd E or even E, eqn. (3.2.81) reduces to 

2 

q (j 

RA(k,k)= Ij- [E+(E 2 -E)a 2 cr 2 +2a o b 2 (E>l) 7 ^“ (W-2). 

j 


1 -b. 


E+1 


a 

o 2 

(l-b 2 ) : 


9 9 9 N IT 

(b~+b^-2b„ ^ ) +b^ t- 1 - E ( z ( EK+i-2 ) z ( Ek+ 3 - 2 ) ) ] 

^ ^ d d i =1 3=1 

i^3 


for odd E, 


(3.2.83a) 
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= V N+(lT2 - N ) a o a u +2a i o b f ( N “ 2 )“ O .(l+to) 

^ ou oi t 1-T3 2 (l-b 2 ) 2 2 


(* 2 -b 


f /2 )^ ^ 


] | 

/_ L ® ( z ( Nk+i-2 ) z ( Nk+ j -2 ))] 


for even IT 
(3.2.83b) 


Thus it can be seen that with N—s'cafor infinite averaging, 
eqn. (3.2.83) reduces to the recursive equation: 


2 2 
0 0 2a^b a 

N-^^ (k ’ k, = a o a u + - Hr 


lim 


lim 2 
2 


IT IT 

n n 

i=1 3=1 
i^3 


E(z(Nk+i-2) z(Nk+;j-2)) 


(3.2.84) 


For m^o eqn. (3 

R£(k,k+m)= K* 
y TT^ 


2.79) can be rewritten as, 

IT N 

> 2_ ®[ (sgn(a u(kT)+n(Nk+i)+bp 

1=1 3=1 


z (Nk+i-2 ) ) * 


(sgn(a 0 u(k+mT)+n(Nk+m+j )+b 2 z(Nk+j-2))] (3.2.85) 


_ ^ „ E[ (a u(kT)+b 0 z(Nk+i-2) (a u(k+mT)+b 0 z(Nk+m+3-2) ) 1 

N 2 i^ j=i 0 2 * o 2 

( 3 . 2 . 86 ) 


j| x^ X\i 

= -4- [a b 0 N 7 E(u(k+mT)z (Nk+i-2) )+a b 9 N 7 E(u(kT) 
ir ° ^ i=i j=1 


p N N 

z ( Nk+m+ j -2 ) +bp y__ E( z (Nk+i-2 ) z(Nk+m+ j-2 ) ) ] 

i=1 3=1 


(3.2.87) 
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This recursive equation may he evaluated for IT odd or even 
and for different values of m* 

Summary : The coarse-sampled-data filter using an RC averager, 

has been introduced by Kirlin [ y ] to replace a linear digital 
filter implementing by a particular difference equation. The 
expected value of its output y(lT) is said to be equal to 
that of the output of the linear digital filter. A saving 
in hardware requirements is made with the use of this 
non-linear filter. In this section (3.2) the first and 
second order coarse sampled data filter, using digital 
counter averagers, are discussed, and the statistics of their 
outputs are compared with those of the outputs of the 
corresponding linear digital filters. It is seen that with 
this form of the coarse sampled data filter, the statistics 
of y(lT) do not approximate those of y(lT). 

3.3 The IT-bit Feedback Coarse -Sampled -Data Filter: 

In the previous section, the coarse-sampled-data 
filter was discussed and it was shown that it cannot be used 
to replace the linear digital filter, as such. A modification 
of kirlin' s filter leads to the N-bit feedback coarse- 
sampled-data filter, the mean and covariance of the output 
of which can be made to match, as closely as desired, the 
mean and covariance of the output of the linear digital 
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filter. The filter configuration is developed as 
follows: 

The output y(lT) of the coarse -sampled -data filter 
is obtained by first resetting the digital counter averager 
to zero. The counter then upcounts or downcounts as 
z(Rl+k) is (+ve) or (-ve) respectively, for k=1 ,2 , . . . 
Subsequently the sum stored in the counter is normalized 
by dividing by R. If it can be ensured that over k=1,..,,R 
the outputs of the comparator, z(Rl+k) ' s , are identically 
distributed and that E[z(Rl+k) ]=E(y (IT) ) , then the expected 
value of y(lT) equals the expected value of y(lT). Th%s 
objective being satisfied, the respective autocorrelation 
functions of the outputs of the two filters, the linear and 
the non-linear, may be compared. 

To ensure identical distributions of z(Rl+k), k=1,...,R, 
(the outputs of the comparator), the feedback for a filter of 
order M, contains, not M elements as in the case of Kirlin's 
coarse-sampled-data filter, but ME elements where R relates 
the dither rate T' and the input/output sampling rate T r 
(T'=T/R). The MR elements of the feedback, z(o ) , z(-1 ) , . . . , 
z(-MR+l) are set at l=o to + 1 or -1 with equal probability 
and are mutually independent. Hence for a linear digital 
filter of order M given by 
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M_ M - 

y(lT)= a.u(ITiT) + X b.y(ITjT) 


( 3 . 3 . 1 ) 


i=° ^ j=l 

the IT— bit feedback coarse-sampled-data filter is given by 
the relations 


M M 

z(!Tl+k)=sgn( a.u(l-iT)+n(ffl+k)+ z(Nl-j+k)) 
i=o 3=1 


y(u) = i 


IT 

z(Hl+k) 

k=i 


(3.3.2a) 


(3.3.2b) 


As in sec. 3-2, the dither, lying in the range (-1,+1), is 
such that 


M M t 

[ Z ] + Z1 b 4 + \ 

1=0 max 1=1 1 I 

and 

r M M 

t ZL ai u(VTT) ] 

1=0 min i=1 ' 


(3.3.3a) 


(3.3.3b) 


Choosing such a range for ’n 1 ensures that the input to the 
comparator, over a period T, is (+ve) as wCll as (-ve), 
avoiding saturation of the output of the c*v«.\ra<j£r which 
makes an averaging of the output of the comparator meaningless. 

The dither noise n ( Nl+k ) is independent between 
samples, is uncorrelated and is uniformly distributed in 
the range (-1,1), i.e. if p (n) is the probability 
density of the dither. 



Tiie output statistics are evaluated for the first 
and second order filters, for the oases of deterministic 
and random inputs. 

3.3*1 The First Order IT-hit Feedback Filter ; 

The first order linear digital filter follows the 
difference equation 

y(lT) = a 0 u(lT)+h iy (~T) (3.3.5) 

The corresponding N-hit feedback filter (Pig. (3.3.1) 
is given by the equations 

z(lTl+k)=sgn(a 0 u(lT)+n(Wl+k)+b 1 z(Nl“+k) (3.3.6a) 

y(lT) = 1 z. z(Nl+k) (3.3.6b) 

iNI k=l 

The added dither n(hl+k) follows equations (3.3.4), 
with M=1 . 

(a) The Deterministic Input: let u(lT) be deterministic, 
its range obeying eqn. (3.3.3). 

(i) The Probability of z(Nl+k) : The probability of z(Nl+k), 
conditioned on z(hl~T+k) is 








3.48 


(1 


a Nl+k | Z N1- 1 +k 


1+a u(lT)+b z^l-l+k) 

z(Nl-1+k))= 2 _J 


(3.3.7) 


P 2 , z (-1 

z 3>l+k z lTl-1+k 


z(KTTT+k)) = 


1-a o u(lT)-b 1 z(lD.-1+k) 


(3.3.8) 


The unconditional probability p( z(lTl+k) ) is given by the 
recursive equation 

1+a u(lT)-b. 


z 


'Nl+k 


( 1 ) = 


1 


+ b 1 P Z , 


( 1 ) 


m-i+k 

JL ( 1+a 0 u(iT)-b 1 ) 


X—O 


b^ 1 2 +- — ^ — (3.3.9a) 


Similarly. 


P, 


J FH-k 


1 -a u(lT)-b 

(_,)= 


+ p~ 
1 z 


(- 1 ) 


Nl-1+k 


_ y 

i=o 


1 1-a u(iT)-b^ b 


1+ 1 

i . b^ 1 + II 


2 1 2 

(3.3.9b) 

A 

Thus z(Ul+k), k=1,2,...N, are identically distributed, 
and independent of 'k' . 


(ii) Tiie Expected Value of y(lT): 

Eqn* (3.3.6) gives the input-output relation for the 
first order N-bit feedback coarse^sampled-data filter. 

Using eqn„ (3 .3 -6b) 
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A « N 

B(y(lT))=l 21 E[z(Nl+k) ] (3.3.10) 

k=1 

Prom eqn. (3.3.6ba) 

E(z(Nl+k)}=B[Sgn(a o u(lT)+n(Pl+k)4-b 1 z(KirT+k))] (3.3-11) 

=E[a Q u(lT)+b z(Ul-1+k) ] 

=a o u(lT)+b 1 E(z(NX:“+k)) ' (3.3.12) 

\ E(z(Nl+k))=a 21 uUTjbJ-’ 1 (3-3-13) 

u i=o ‘ 

¥e see that E(z(El+k) ) is independent of k. Substituting 
E( z(Nl+k) )in (3.3.10) we obtain 

E(y(lT))=i 21 [a 2T u(iT)b^’ i ] 

“ k=1 0 x—o 1 

= a 2 u(iT)b|'" i (3.3.14) 

i=o 

Comparing eqn. (3.3.24) with eqn. (3.1.9) we see that the 

/N 

expected value of y(lT) equals y(lT), the output of the linear 
digital filter, for a deterministic input u(lT). Comparing 
eqn. (3.3.13) with (3.1.8), we see, too, that 


E(z(Nl+k)) = y(lT) 


(3.3.15) 
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(iii) The Time Autocorrelation of y(lT) : 

let the time autocorrelation function of y(l'T) he 

denoted hy R\(m) 

5^* 


K 

®y( m ) = K+T X y( kT )y(S+mT) (3.3.16) 

BA(m) is a function of the added dither n(Nl+k). Hence 

E(BA(m))= gL. E(y(kT)y(k+mT)) (5.3.17) 

To evaluate E(y(kT) y(k+mT)) 

For m=o 

H JL 

E(y(kT)y(kT))= !*• X 2_ B( z(Hk+i) z(Nk+ 3 ) ) 

ir i=i 3=1 


N 


w 


E(z^(Nk+i))+ 


i =1 


N H 

X-B(2(Nk+i) Z (Hk+3))] 
i =1 3=1 

(3.3.18) 


E( z(Nk+i) z(Hk+ 3 ) ) 


=E[sgn(a o u(kT)+n(Hk+i)+h^ z(Nk- 1 +i) ) . 

Sgn(a o u(kT)+n(Hk+ 3 )+h 1 z(Hk“+ 3 ))'] 

= a 2 u 2 (kT)+a Q u(kT) .h^ [E( z(Nk^T+i)+ 

z(MEIT+3))]+t|E(z(Hk“+3)z(Nk^+ 

= a 2 u 2 (kT)+2a Q u(kT) -b^ y(k-1 T)+b 2 - 

E[z(Hk~1+3 ) .z(Nk- 1 +i) ] 

= y 2 (kT) 


(3.3. 19a) 
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E(y(kT)y(kT)) = -L- [l+ (N 2 -F)y 2 (kT) ] (3.3.19b) 

IT 

In the limit as EH»=>c> 

^oc*!(y(kT)) 2 = y 2 (kT) (3.3.20) 

For m^o . 

a a _ i N N 

E(y(kT)y (k+mT)= ~ 21 2_ E( z(Fk+i) z(Kk+m+ j ) ) (3.3.21a) 

N i=1 3 = 1 


_ 1 


E 


E N 


2 C 21- E(z(Fk+i)z(Nk+m+i) )+ 21 22 


a i=1 


i=1 j=1 
i^3 


E ( z ( Nk+i ) z ( Nk+m+ j ) ] 


E(y (kT)y(k+mT) ) 


= -L 

m> o F 4 


_ m-1 . 

[N(h^+a o y(kT) 21 u(k+m-i)) 


1=0 


1 


+(F -F)y(kT)y (k+mT) ] 
1 r^-uM 


(3.3.21h) 


tml-1 


E(y(kT)y(k2mT))j = f U ( lo j ^ + a o y(k-f-mT) 2 b^u(k-iT)) 


1=0 


+ (N 2 - H)* y(kT)y(E+¥T)] (3.3.21c) 


Therefore, j.n the limit as F->oo, for infinite averaging and 
for all m E(y (kT)y (k+mT) ) tends to 

JJU E(y(kT)y(k+iT)) = y(kT)y(SiT) (3.3.22) 
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In the limit , as 1? ->oo , the expected value of RA(m) 

y 

(eqn. 3.3.17) tends to 

^ <w E(RJ(m)) = gj- y(kT)y(k^T) (3.3.23) 

But by definition (eqn. 3.1.11), the RHS of (3.3.23) is the 
time autocorrelation function of y(lT) . 

E(RA(m ) = R y (m) (3.3.24) 

This implies that if the filter be allowed to run for an 
infinite length of time to obtain each sample of the output 
y(lT), the expected value of the time autocorrelation 
function of its output y(lT) shall equal the time auto- 
correlation function of the output y(lT) of the linear 
digital filter. 

(b) The Random Input ; let u(lT), the random input to the 
filter, be defined as in eqns. (3-1.15). The input-output 
relationship of the first order N-bit feedback coarse sampled 
data filter is given by the eqns. (3.3.2) and the range of 
u(lT) satisfies eqn. (3.3.3). The statistics of the output 
y(lT) may be evaluated thus; 

(i) The Probability of z(Rl+k): z(Nl+k) is given by eqn. 

a 

(3.3.6a), It is/function of n(Rl+k) , u(lT) and z(Nl~1+k) 



The random input u(lT) is independent between samples, 
hence u(lT) and z(Nl+r+s) r< o , all s are independent. 

The probability of z(Nl+k) , therefore, conditioned on 
u(lT) and z(Nl— 1+k), is given by 

1+a o u(lT)+b 1 z(U“+k) 

- 

( 3 . 3 . 25 *) 

1 -a u ( IT ) -b , z ( 1'11-T+k ) 
,u(lT)= 2 _J 

(3.3.25b) 


z ITl+k | Z ET1- 1 +k , U 1T 


(-1 


z(Nl-1+k) 


z. 


Nl+k \ "Ul-l+k , U 1T 


( 1 ] z(ITl-1+k) ,u(lT) ) = 


The probability of z(ET-t-k) conditioned on z(lTl-1+k) alone, is 
therefore given by 


p(z(Ul+k) z(STl~1+k) ) = 


u 


p (z(Kl+k)l z(HT-1+k) ,u(lT) ) 


p(u(lT)). du(lT) 


(3.3.26) 


, 1+a n +b. z(m-1+k) 

* tz (1 z(Fl3T+k)) = 2-2L-1 

z Ni+k| z Nirr+k 1 2 


( 


p 


(-1 z(K~+k)) = 


1 ^o^u"* 13 1 z 1 


z 


Hl+k 


m-i+k 


(3.3-.'27a) 


(3.3.27b) 


where r) = E(u) 


(3.3.27c) 


In the form of recursive equations, p(z(!Tl+-k)) is given 
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1 + a„r), -b, 

P (1) = g I +l3 1 P z „__ 

z Nl+k * 1 z M-1+k 


(0 


(3.3.28a) 


1+a o%^i 4- .l-i . h 

. 2 Gs 1 2 


i+i 


(3.3.28b) 


Similarly, 


z 


Nl+k 


(- 1 ) = 


1 " a o r) u'" b l 


+ b 1 P z 


(- 1 ) 


TTl-1+k 


(3.3.29a) 


1 -at) -b 1 i 13 . 

- ¥ 


1+1 


(3.3.29b) 


Eqns. (3.3.28b) and (3.3.29b) show that p(z(El+k)) is 
independent of k, and that z(El+k), k=1,...,F are identically 
distributed . 

fit 

(ii) The expected value of y(lT)s 

y(lT) is given by eqns. (3.3.6), u(lT) being random. The 
expected value of y(lT) may be evaluated as follows. 

/ , F 

B(y(lT)) = i XL E[z(Fl+k)] (3.3.30) 

k=1 

From eqn. (3.3.6a) 

E(z(Fl+k) ) =E [ Sgn ( a Q u ( IT ) +n ( Fl+k ) +b 1 z ( FT^T+k ) ] (3.3.31 ) 

= E[a u(lT) + b 1 z(Fl-1+k) ] 


= a o p u 


1_ 

2- b 

i=o 


1-i 


(3.3.32) 
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We see that E( z(Nl+k)j is independent of k. Substituting 
(3.3.32) in eqn. (3.3.30), we get, 

a 1 N 1 1 • x 

E(y(lT)) = X (a o p X X ) (3.3.33) 

k=1 i=o 

1 i • 

= a o\ X- (3.3.34) 

i=o 

Comparing eqns. (3.3.34) and (3.1.16), we see that the RHS 
of (3.3.34) is equal to E(y(lT)). Hence the expected values 
of y(lT) and y(lT) are equal, even if r) ^ 0 . We also 
observe that the RHS of eqn. (3.3.32) is equal to E(y(lT)). 
Therefore, 

E(z(Nl+k)) = E(y (IT) ) (3.3.35) 

(iii) The Ensemble Autocorrelation of y'(lT); is defined as 


R/s(k,k+m) 


E[y (kT)y (k+mT) J 


. H N 

4 XX- E ( z ( Hk+i ) z ( rrk+m+ j ) ) 
n i=1 j=1 


(3.3.36) 

(3.3.37) 


Eor m=o 


R^k,k)= n 
J N 


N N 

X JZ E ( z ( Hk+i ) z ( Hk+ j ) ) 
i=1 3=1 


(3.3.38) 


1 H 0 H H 

= 4 [ X E ( Z (Hk+i))tl. X E(z(Nk+i)z(Nk+q))] 

IT i=1 i=1 3=1 


Oj 


(3.3.39) 
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It is known that z(Ek+i), z(Nk+j) i^j for all i,j are 
identically distributed, hence the second term in ( 3 . 3 . 39 ) 
may be evaluated thus % 

N N 

Z- Z. S[z(lk+i)z(Nk+j ) ] = (K 2 -M)E[z(Nk+i)z(hk+j) ]. , . 
i =1 3=1 

(3,3.40) 

= (U 2 -h )E[sgn(a Q u(kT)+n(lTk+i)+b 1 z(Ek~T+i) ) . 

Sgn(a o u(kT)+n(lTk+ j )+b 1 z(EkIT+ j ) ) ] ± ^ . (3 .3.41) 

= (1T 2 -~E)E[ (a Q u(kT)+b^ z(Nk- 1 +i) ) (a Q u(kT)+b^ z(Nk-V+ j 

(3.3.42) 


<E 2 -E)[a 2 cy 2 +a o b 1 . E^u(kT) z(JSTk-1 +i)+u(kT) z (Me - 1 + 3 )| 


+b 2 E(z(Nk-1+j)z(Nk-1+i))] i ^ 

= (E 2 -E)[aV+b 2 E(z(Nl3T+i)z(NETT+3))] i7 4 ;j 

2 k +2 


p p p ( 1 ~"6 < 

(ISr-N) a 2 of L 

° u 1 -b 


) 


1 


*y 


(k,k) = K [N+(N 2 -N).a 2 a 2 ^ 1 

IT 1-b* - 1 


2k+2 


In the limit, as N-y3ofor infinite averaging, 

2 k +2 




1 ~b 


1-b 


(3.3.43) 

(3.3.44) 

(3.3.45) 


(3.3.46) 
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Form^o 


F 




RA( k , k+m )= [ ^E(z(Nk+i)z(lTk&i) )+ ^ 


FT i=1 


i=1 3=1 


if 


E( z(Nk+i) z(Nk+m+j ) ) ] 


[Nb“ +(N 2 -U)-b“ a 2 a 2 


(3.3.47) 


1 ~b 


2k+2 

1 


1 o u ,2 
1 " b 1 


] m y o 


(3.3.48a) 


1 I ml 9 \ \ o o i _b 2 (k+m)+2 

CN b( m + (S' 2 -11)13 1 m a 2 cr 2 1 ? ] m< o 

I 1 O U v 


F 


1 -b. 


(3.3.48b) 


In the limit, as N->co for infinite averaging, R* (k,k+m) 
tends to a limiting values 


1±m oo RMk.k+m) = a 2 a 2 ( 1-b 2 )” 1 m = o 


N-»‘ 


'o u' 1 


(3.3.49a) 


= a 2 a 2 bj m ^ (l-b^ k+m ^ +2 ) (i-b 2 )-" 1 m< o 

(3.3.49b) 

= aV b," (l>b 2k+2 ).(l>b 2 r 1 m> o 

(3.3.49c) 

Comparing eqns. (3.3.49) with eqns. (3.1.25), we see that 


= a y (k,k+m) 


(3.3.50) 
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where R y (k,k+m) is the ensemble autocorrelation function 
of the output of the linear digital filter. 

3.3.2 The Second Order CT-bit feedback Filter ; 

A second order linear digital filter follows the 
difference . equation 

y ( kT ) =a Q u ( kT ) +b 1 y ( S>TT ) +b 2 y(k=2T) (3.3.51) 

The corresponding Ef-bit feedback coarse- sampled -data filter 
is shown in Tig. (3.3.2). The relation between the input 
u(lT) and the output y(lT) is given by the equations: 

X(Nl+k)=sgn(a o u(lT)+n(Rl+k)+b 1 z(ETiZT+k)+b 2 z(N1^2+k) ) 

(3.3.52a) 

K 1 N 

y(lT) = i £ z(Nl+k) (3.3.52b) 

iM k=1 

Since this is the coarse-sampled-data filter 
implementation of a linear filter of order two, therefore 
as stated earlier, the feedback consists of 2ET elements. 

At l=o, the feedback contains z(o), z(-1 ) , . . .z(-2F+i ) each 
of which is +1 or -1 with equal probability i.e. 

p (1) =P (-1) =i r=o ,-1,-2,..., -2R+ 1 (3.3.53) 

z r z r ^ 

The added dither n(ETl+k) follows eqns. (3.3.3) and (3.3.4), 
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1-1 


1+1 


2 t i 1 + a 0 U(l '- 2iT) ^2 , 1 fL — , 

2 + 2 (b 2 ' 


2 

i=o 


for odd 1 


(3.3.57c) 


Similarly, 

p (-1) 

z Ul+k 


1-a 0 u(lT)-b 2 


+ b 2 P z 


(3.3.58a) 


Ul-2+k 


1/2 


= X- b d~ a 0 u(l-2iT)-b )tj + U\ ol +l/2 ) 


1=0 


- 0 -x- ✓ ~> 2 ' 2 2 2 

for even 1 (3.3.58b) 


1-1 

2 


2— ~ ( 1-a o u(l-2iT)-b 9 ) .bj + ~. b 


1=0 


1+1 

i , 1 -.2 

2 / * “2 + 2 * °2 


for odd 1 


(3.3.58c) 


Thus z(Nl+k) ,k=1 ,2, . . . ,K are identically distributed and 
independent of *k’ . 


(ii) The Expected Value of y(lT) ; Using eqn. 

we obtain 

A 1 JL 

E (y (IT) ) 4 I E( z(Nl+k) ) 
iN k=1 

Using eqns. (3.3.57) and (3.3.58), 

1/2 i 

E(z(Nl+k) )=a Q y u(l-2iT).b 2 for even 

1=6 


(3.3.54b ), 

(3.3.59) 


1 


(3.3.60a) 
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( 1 - 0/2 

=% Z_ u(l-2iT).bi for odd 1 (3.3.60b) 

i=o ^ 

Therefore, 

(\ 4 1/2 

E(y(lT))= i(N).a 2- u(l-2iT).b* for even 1 

i=o d 

(3.3.61a) 

( 1 - 1 )/2 

= a Q X u(l-2iT). bj odd 1 (3.3. 6lb) 
i=o ^ 

= B(z(Nl+k); (3.3.61c) 


Comparing eqn. (3.3.61) with the RHS of eqn. (3.1.50) we 

i 

see that the expected value of y(lT) equals the output of 
the linear filter y(lT), when u(lT) is deterministic i.e. 

JB(y(lT)) = y(lT) (3.3.62) 

Since E(y(lT)) = E(z(Nl+k)), therefore when u(lT) is 
deterministic 

E(z(Nl+k))= y (IT) (3.3.63) 

(iii) The Time Autocorrelation Function of y(lT): is defined 
as follows: 

B$(m) = fjr 21 y(kT)y(k+mT) (3.3.64) 

J k=o 

RA(m) is a function of the added dither n(Nl+k) . Thus 

y 

K 

E(R*(m))= gX- r B(y(kT)y(E5T)) 


(3.3.65) 
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The inner term is given "by 
£(y(kT)y(k+mT) )= E[ 


. M 

7 Z 2~ z(Bk+i) z(Fk+m+j ) ] 
JT i=i fi] 


1 F J7_ 

77 XL 2__ E ( z ( Fk+i ) z ( Nk+m+j ) ) 
F i =1 j =1 


(3.3.66) 


(3.3.67) 


For m=o 


h p « F F 

E(y(k)) = - 7 - XI Z* B(z(Mk+i)z(Kk+ 3 )) 
F i =1 3=1 


(3.3.68) 


1 . JL p MB 

77 [ 2-E(z (Mk+i) )+ XT 2lE(z(Mk+i)z(Mk+3))] 
M i=1 i=1 j=1 

(3.3.69) 


H M 

"2 ^ T+ 1- XL S] sgn(a u(kT)+n(Nk+i)+'b ? z(Fk-2+i) ). 
J . i =1 3=1 *“ ^ 

i^d 

Sgn(a 0 u(kT)+n(Nk +3 )+l) 2 z(NkE 2+3 ) ) ] 


F_ X 

77 [E+ 2. Z_ E (a u(kT)+k 9 z(Mk~2+i) . (a u(kT) 

F 


i=1 d=i 
i^d 


+b 9 z(Fk~2+d ) ) ] 


« F F , p 

■*2 0+ X 2- a^(kT)+a o b 2 u(kT)E(z(Fk-2+i) 
F i Id ^ 

i^d 

+ z ( Fk^ 2 + j ))+b 2 E(z(Fk^2+i)z(Mk^2+d)) ] 



_ 1 


, r II 

JJ? 1 -N+ g. a 0 u^(kT)+2a 0 u(kT) ,b 2 y(k- 2 T)+ b|- 


'*-J 


E( z(Hk~ 2 +i) z(Hk^ 2 + 3 ) ) 3 


(3.3.70) 


~ [N +(E 2 -N) y 2 (kT) ] 


F 


(3.3.71 ) 


Therefore, 


K 


E(R^(o) K-^c» g+y 5 ^ [F+ (F^-Fjy^ (kT) 

k=o N 


(3.3.72) 


In the limit, as E(R*(m)) tends to 

F^>*> E ( R y(°) ) = ^ 


(3.3.73) 


But the RHS of eqn. (3.3.73) is the time autocorrelation 


R (m) of y(kT) at m=o 

y 


rI^co R y(°) 


(3.3.74) 


Eor mA>:~ 

. . . F F 

E(y (kT)y(k+mT) )=E[-U- 2_ 51 Z(Ek+i) z(Nk+m+ 3 ) ] 

N i =1 j -1 


F 


[ T" E( z(Fk+i) z(Hk+m+i) )+ (F -F)E( z(Fk+i) 

F i=1 

z(Nk+m+j ) ) . . 3 (3-3.75) 

m/ 2 i- 

V [E(h “/ 2 +y (kT) . XI b o .u(k+m32qT) ) 

IT 1 q=o 

+(N 2 -E)y (kT) .y (k+mT) ] m>o and even 

(3.3.76a) 



= V f>(b!. m l /2 +y(E+£T) xf b§ u(E=2qT)) + (N 2 -U). 
IT 1 q=o~ 2 
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y(kT)y(k+mT) ] m<o and even (3.3.76b) 


If m is odd, z(Ek+i) , z(Uk-i-m+i) are always independent, for 
all i,j, therefore 


E(y(kT)y(k+mT))= ^ 

N 


1 N 

XL XL E( z(Nk+i) ) „E( z(Nk+m+o ) ) 
i=1 j=1 

(3.3.77a) 



E 2 .y(kT) .y (k+mT) =y (kT)y (k+mT) 

(3.3.776) 


Using eqns . (3.3.76b) and (3.3.76), we see that, for 
all m, in the limit, as N— > oa 


B(y(kT)y(k+mT)=y(kT)y (k+mT) all m (3.3.78) 

1M T 00 

' E(H y (m))= k“oo ST t I j(«)r(®) a11 m 

= a (m) (3.3.79) 

y 

where R (m) is the time autocorrelation function of y(kT) . 

y 

(b) The random input : The input u(lT) is random, its range 


obeying eqn. (3.3.3) for M=2. 



5.66 


(i) The Probability of z(JSri+k) : The probability of z(Nl+k), 
conditioned on both u(lT) and z(Nl^2+k) is found to be 


z 


Nl+k *Nl-2+k, u lT 


, 1+a u(lT)+b 0 z(BFl-2+k) 

(lU(Nl-2+k),u(lT)) = 2 —2 __ 


(3.5.80)_ 


P 


J Nl+k 


i _ 1 -a u(lT)-b 0 z(Nl-"2+k) 

(-1 z(Nl~2+k) ,u(lT)) = 2— 2 


Rl-2+k U 1T ' 1 2 

(3.3.81) 

p(z(Nl+k)J z(N1^2+k))= J p(z(Nl+k)j z(NL^+k), u( IT))- 

u 

.p(u(lT) ) .du(lT) (3.3.82) 

Therefore, 


z. 


Nl+k 


, i , . 1+a r, +b ? z(Nl-2+k) 

, (1 z(HT3+k))= 2_a_2 

z Nl-2+k l 2 


(3.3.83) 


1 -a _rj -b 0 z(Nl-2+k) 

S v I (-1 \z(Nl-2+k))* (3.3.84) 

2 Nl+k \ z Nl-2+k 


The unconditional probability of z(Nl+k) is given by the 
recursive equation 


z 


( 1 ) = 


,+a o ri 'u” b 2 


’Nl+k. 


+ b p p (1) 

2 z 3n-2+k 


(3.3.85a) 


1+a T) — bp 1/2 • 1 -1/04.1 

£— — 2 '2__ bp + ^ .bg 2 for even 1 

(3.3.85b) 


1=0 


1+ a oV b 2 <tl l)/2 v.1 „ i Jl*D/2 

2 2- b 2 2* D 2 


1=0 

for odd 1 


(3.3.85c) 



Similarly , 


m+k 


(-1) = 


1 ” a o %- b 2 


+ b 2 P z. 


Hl-2+k 
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(-1) (3.3.86a) 


kvv b 2 


, - a o , V b 2 


1/2 

X b 2 + b 2 


1 / 2+1 


1=0 


even 1 


(3.3.86b) 


(1-1 )/2 . b^ 1+l)/2 

X b 2 + -S — 

1=0 £ - 


odd' 1 (3.3.86c) 


Hence z(Hl+k) ,k-l ,2 , . . . ,H are identically distributed 
and ind ep end ent of ' k ' . 


(ii) The Expected Value of y(lT) : 


■ K 1 


H 


E(y(lT) )= -4r- > E(z(Nl+k)) 

" kXf 


(3.3.87) 


1/2 


E(z(Hl+k))= a Q p u ^ bg for even 1 (3.3.88a) 


1=0 

( 1 - 1 )/2 


=a T) 
o 'u 


bi for odd 1 (3.3.88b) 


k=o 


Hence 


a 1/2 , 

E(y(lT))= a Q p u / Ip for even 1 

i=o 


(3.3.89a) 


( 1 - 1 )/2 
a <Ai T- 


1=0 


for odd 1 


(3.3.891) 
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Comparing eqns . (3.3.89) and (3.3.88) with (5. 1.50), we 
see that E(y(lf)) equals the expected value of y(lT), and 
that E( z(El+k) )also equals E(y(ll)) i.e. 

E(y(lT) )=E(z(KL+k) )=E(y(lT) ) k=1,2,...,F (3.3.90) 

( Hi) Tiie Ensemble Autocorrelation of y(lT): is defined by 
EA(k,k+m)=E[y(kT)y(k+m'i) ] 

1 N N 

Z H z(Nk+i)z(Fk+m+j) ] (3.3.91) 

N i=1 j=1 

/ | i I I 

RMk,k+m) = -*■ [N+ Z ZL E[z(Fk+i) z(¥k+ j ) ] 

J m=o JSr i=i i=i 

= [l+(N 2 -N) E(sgn(a u(kT)+n(Nk+i)+b 0 z(Hk^2+i) ) . 

ir 0 z 

sgn(a o u(kT)+n(Ek+ j )+b^ • 

z ( Nk^2+ j ) ) ] 

= [E+(N 2 ~N) a 2 E(u 2 (kT) )+2a E(u(kT) ) . 

ir 0 0 

b E(y(kE2T))+b 2 E( z(Nl^+i) z(Ek^ 2+3 ) ) ] 

i^3 


= •4 [E+(lT 2 -N)E(y 2 (kT))3 (3.3.92) 

N 

In the limit as 1 

= R y (k,k) 


(3.3.93) 
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— j-§ 0< ^6- , and z(Ek+i) and y(kf) are given by eqns. 
(3.3.54a) and (3.1.50) respectively, then z(Hk+i) ,z(NE+5+3) 
are mutually independent for all i,j. Similarly y(kT), 
y (k+mT) are independent. Therefore using (3.3.91), 

. kl I 

•RA(k,k+m)= 27 > E( 2 (srk+i)).E( Z (Nk+S+j)) ( 3 . 3 . 94 ) 

J h i =1 3 = 1 


E(y(kT) ) .B(y(k+mT) ) 


o ( '/ h u = o) for odd m 


(3.3.95) 


When m is even , and k=2n or k=2n+1 and k+m=2r or k+m=2r+1 


S N N 


RMk,k+m)= 4_ [ -Jr E( z(Nk+i) z(Fk+m+i) )+ % 2_1 


N' 


i=1 3=1 


E( z(Nk+i) z(Nk+m+3 ) ) ] 


(3.3.96) 


v [u *bi m ^ 2 + b^ mi/2 zr 21 

jr ^ ^ i=i 3=1 

i^3 

E( z(Fk+i) . z(Nk+j ) ) ] 


(3.3.97) 


RA(k,k+m) 

J \ m y o F 


[N.b 2 m / 2 + b 2 m//2 .(E 2 -N)E(y 2 (kT)) ] 


(3.3.98a) 


Substituting from (3.1.54a) in (3.3.98a), we obtain 

. 2n+2 — 

I = K [tf.b " /2 + b .a|4 . V- J 

I m s n T.T 2 2 2 ° U 1 -K J 


RA(k,k+m) i - ~2 l --■ s * w 2 ' “2 

^ ' m y- o IT 


(3.3.98b) 
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R£(k,k+m) 


_ x_ 

m< o 


[N.b 


h|/2 +b | n l/2 


W IT 

21 21 

-i=1 3=1 


B ( z ( Nk+m+ i) z ( Uk4-m+ j ) ) ] 


(3.3.99) 


R^(k,k+m) 


= -h [u.-bkl / 2 + (u 2 -u).b! 1 m // 2 - E (y 2(k+mT))] 

m< o IT d 2 

(3.3.100a) 


Substituting from (3.1.54a) in (3.3.100a), we 
RA(k,k+m)j= ~ [U.bN/ 2 + (U 2 ~R) .b| m ^ 2 . a Q a 2 

1Ti<0 


obtain, 

1-bf +2 

1 ~b 2 


(3.3.100b) 


Using eqns . (3 .3 .95) , (3.3.98b) , (3.3.100b), in the 
limit, as U — > 00 


jj^oo RA>(k,k+m) = By(k,k+m) all m. 

SUMMARY : 

In this chapter the coarse-sampled-data filter and 

the In - bit feedback coarse-sampled-data filter have been 

investigated. It is found that the performance of tie 

is not 

coarse-sampled-data filter/close to the performance of 

the output of the corresponding linear digital filter whereas 
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for both, the cases of the deterministic and the random 

A 

inputs, the expected value of the output y of the E-bit feed 
back sampled data filter is equal to the expected value of 
the output y of the linear filter. It is also shown that 
as N increases, i.e. as the dither rate T' increases for a 

fixed input sampling rate 1(T'=T/N), the auto-correlation 

A 

function of y the output of the K-bit feedback sampled -data- 
filter asymptotically approaches the auto-correlation 
function of y the output of the linear digital filter i.e. 

E f.y) = E(y) 

and RK(k,k-Hn) = Ry (k,k+m) . 

At steady state, i.e. with k tending to infinity, y(ll) 
becomes stationary i.e. (k ,k-tm)=Ry(m) , therefore 

when the E-bit feedback filter is allowed to run for some 
time, its output must become stationary, i.e. when the 
non-linear filter reaches steady state, the power spectrum 
of its output may be defined. Because the autocorrelation 
functions of the outputs of the linear and nonlinear filters 
are equal in steady state, therefore the power spectra 
must be equal also i.e. 

S* (CO ) = Sy(^) 

When a comparison is made of the hardware requirements for 
the coarse-sampled— data filter and the N-bit feedback 
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sampled-data filter, it is seen that for the implementation 
of the same order i'i of linear filter, both the nonlinear 
filters require the same units - a summer , shift register, 
comparator and digital counter averager. The difference 
lies in the fact that the feedback register length for the 
c oarse-sampled-data filter is ii, whereas the register length 
is m for the IT-bit feedback coarse-sampled-data filter. 

But the additional cost due to the longer register length 
requirement, is more than made up for, as thejautocorrelation 
of the output of the latter filter may be made to approach 
to any degree of accuracy, the autocorrelation of the output 
of tho linear filter. The output of the coarse-sampled-data 
filter has been shown to match the output of the linear 
filter neither in the mean, nor in the correlation. 

A third filter, whose performance is intermediate 
between that of the coarse-sampled-data filter and the IT -bit 
feedback sampled-data filter, has been developed. The 
input/output relation is given by the equations 

M M 

z(Ul+k)= sgn ( a.u( 1-iT) +n(lTl+k)+ z(Bl- j+IT) ) 

i=o 1 j=1 

* i N 

y(lT) =| X z(Nl+k) 

1 k=1 

Prom inspection of the equation for z(Nl+k) , it is seen 
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that at time t=Nl+k, k=1,..N , the values z(Ns+N) , 
syl-1 , 1-2, 1-M are stored in the feedback register, i.e. 
the feedback register length must be M. It can be shown 
that the expectation of the output of this filter equals 
that of the output of the linear digital filter. However, 
the autocorrelation of its output is larger than that of 
the output of the H-bit feedback filter, while being lesser 
than that of the output of the co arse-sampled -data filter. 
Here, a tradeoff between the cost of the filter and the 
degree of the accuracy of the output of the filter, must be 
made, in deciding on the nonlinear filter, A study by 
simulation has been made only of the N-bit feedback sampled— 
data filter, however. 



CHAPTER 4 


RESULTS OF SIMULATION OF IT-BIT FEEDBACK 
COARSE -SAMP LED-DATA FILTERS 


In Chapter 3? a study was made of what was called 
the N~hit feedback coarse-sampled-data filter which was 
developed to replace a linear digital filter. The advantage 
was a simplification in hardware. In theory (Chap. 3.3) 
it was found that the output of this nonlinear filter 
could be made to approximate as closely as desired the 
output of the corresponding linear digital filter in the 
correlation -invariance sense. 

This chapter outlines the study made of the 
performance of the nonlinear filter by simulating it on 
the computer DEC-10, which is a 36-bit wordlength machine. 
Sec. 4.1 discusses the program written for the DEC-10 
to simulate the nonlinear filter. Sec. 4.2 discusses the 
performance of 1st and 2nd order nonlinear filters as 
obtained by simulating them on the machine. 

4.1 Simulation in Fortran-10; 

A program NLF (Non-Linear Filter) was written in 
the computer language FORTRAN-10 to simulate the 
nonlinear N-bit feed-back coarse-sampled-data filter on 
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the DEC- 10 computer. A listing of the program is 
provided in Appendix A. The variable names used for 
some pertinent quantities, input, output and intermediate, 

are explained as follows i 

\ 

The linear difference equation from which the 
nonlinear filter is derived is given by 
RTf B.Y 

y(lT)= 21 a t u(l~i+fl)+ T b y(l-jT) (4.1.1) 

i=1 R 3 


Cohsequently , the nonlinear filter is given by the equations 

SET RY 

Zhat = 21 a.u(l-i+lT)+ n(ffl+k)+ ’ST b.z(Nl-j+k) 

i=i 1 Wi 3 



(4.1.2) 

z(Nl+k) = Zhat/ jzhat j 

(4.1.3) 

N 

(4.1 .4) 

Yhat(lT) = ( JZ z(Nl+k)) LIMH/H 


Here n(Nl+k) is given by 

n(Nl+k)=(IIMN) .(EFB(Nl+k)-0.5) .2.0 (4.1*5) 

where REB(Hl+k) is a pseudo-random number lying in the 
range (0,1) and generated by the computer library program 
OOUB. The factor '2.0' normalizes the value (HFB(Nl+k)-0.5) 
to the range ( — 1 ,1). LIMIT is the magnitude of the 


i 
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maximum excursion of n(Nl+k) either above or below zero. 
In terms of the filter coefficients and the input u(lT) 


LIMN > [ 


RU 

i=1 


u(l-i-t-fT) ] + 

max 


r EL 



(4. 1 .6a) 


Other variables used are T,N,MU and M. They are explained 
thus : 


-LIMN 4 [ ZL a. u(lTT+TT)] . - 

^ j __1 3. ' J mrn 


T i is the input/output sampling period. 

N : relates the period T' of the dither n(Nl+k) to the period 
T of the input, thus T’=T/N. If the order of the linear 
digital filter is RY, the number of elements in the 
feedback register is (RY)(N). 

MU: (MU) .T is the time allowed to elapse after which the 

filter is assumed to be in steady state i.e. the output 
of the nonlinear filter is assumed to be stationary. 

M : At time (MU).T, when the filter is assumed to be well 
into steady state, the previous M values of say, the 
output i.e. Yhat (MU-M+T t) , ..., Yhat(MU) are used to 
obtain the power spectrum of the variable, which in 
this case is Yhat. 
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Before the first value of u(lT) is input to the system, 
the feedback ( z( 3 ) , j=o ,~ 1 , -ff(RY- 1 )+l) is initialized. A 
pseudo -random number YY, generated using the external 
defined function RRDYl(X) on the computer, is used (YY=RFDY 1 (X) ) . 
REDY 1 (X) , and hence YY, lies in the range (0,1). To 
satisfy the condition 

P 7 (1 ) = P_ (-1) = i ( 3 = 0,-1,...,-R(RY-l)+l) 

3 3 

(4.1.7) 

z(j) is initialised to +l(~l) as YY is greater than or 
equal to (less than) 0.5, or vice versa. The filter may 
now be allowed to run, generating an output value Yhat(lT) 
for every input value u(lT). It is seen that, to reduce 
the possibility of any correlation between the dithering 
noise n(Nl+k) and the initial values of the feedback 
z., j=0, -1 , . . . ,-N(RY-1 )+1 , their generators in the system 

J 

must be two physically different, independent random 
number generaters, as G-G-UB and ENDY1 are. 

The M-point power spectrum of a particular variable 
is obtained by using the subroutine MEM, which uses the 
Maximum Entropy Method for the derivation of the power 
spectrum of a variable from corrupted data. 
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4.2 Simulation Results % 

The computer program used to test the performance 
of the nonlinear N-hit feedback sampled-data filter has 
been described in the previous section. The program was 
used to simulate first and second order nonlinear filters. 

The First Order Filter ; follows the linear difference 
equation 

y(kT) = u(kT) + ay ( k-i'T ) (4.2.1) 

where, to ensure the stability of the filter, |aJ4-l. 

The performance of the first order nonlinear filter was 
tested for various inputs. 

(a) Input Zero: When the input to the nonlinear filter is 
zero, the output y(lT) is given by the equations 

RY 

z(Nl+k)= Sgn(n(Nl+k)+ 21^ z(wm+k) ) (4.2.2) 

i=1 

y(lT) = i z(Nl+k) (4.2.3) 

" k=1 

The output therefore shall be the natural or the 
initial condition response of the nonlinear filter. It is 
zero mean and converges to zero with time because circulation 
through the filter causes the feedback to be weighted by 
a 1 which is a decaying term. This is illustrated in 
Fig. 4.1, where the output was obtained by setting u(n T ) 



y(nT) 
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Fig. 4.i Initial condition response of 
first order N-bit feedback 
sampled- data fitter. 
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to zero and allowing the filter to run. The output y(nT) 
is seen to be zeromean, and close to zero. 

(b) Step Inputs When the input u(nT) to the linear filter 
is a step function, the output y(nT) must ultimately 
reach a constant value given by 

y(nT) = (4.2.4) 

Because E(y(nT)) =E(y(nT)) 

Therefore E(y(nT) = (4.2.5) 

1 cc 

For a particular u(nT) and a, the range of the dither 
LIME is determined from 


LIMB > u + 

max 

hi 

(4.2.6) 

-LIMB ^4 « - 

mxn 

M. 


In this case u = 

IndijL 

u min = u o 


LIMB u Q + | 

, a l 

(4*2.7) 

-LIMB ^ u Q - | 

! a 1 


LIMB - max [ 

Sv Wl - K - t al l ] 

(4.2.8) 


A 

The maximum value that y(nT) may attain is 


- if ( g- Z(1,n+k) max ™ 


1 . B LIMN = LIMB 


(4.2.9* 
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Therefore if LIMN^j-j — , the output of the 
nonlinear filter shall saturate at +LIMN. This implies 
that the range of the input u(nT) is constrained by the 
inequality 

, u 

max [ju 0 + j a | j , |u Q - (a| ]> — ~ (4.2.10) 

This is illustrated in Fig. 4.2 for which a=0.75. The 
output corresponding to an input = 0.5 to the linear digital 
filter i.e. 2.0 LIMN=1.25. The nonlinear filter output 

saturates at 1.25. 

(c) The sinusoidal Input; The performance of the first 
order IT -bit feedback sampled -data filter is evaluated when 
the input is sinusoidal of the form 

u(kT) = cos ) (4.2.11) 

the period of the input being AT seconds. Eqn. (5.3 .(&) 
for the expected value of the output of a linear filter is 

1 . 

E(y ( IT) ) = 21 u(l-iT) (4.2.12) 

i=o 

The output y(lT) is therefore the weighted sum of sinusoidal 
terms, each of period AT secs. Hence y(lT) must be 
periodic with period AT secs. 



1.25 



Fig. 4.2 Firs 
UK 


20 


30T nT 


y (nT) = u(nT) + 0.75y(n^lT) 


nT) = -0.5 
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The output of the N-bit feedback sampled -data 
filter, corresponding to the linear difference equation 

y(kT) = u(kT)+ 0.75 y(ETT) (4.2.13) 

where the period of the input is 16T, is depicted in 
Pig. 4.3(a). The output y(lT) is indeed seen to be 
sinusoidal with period IbT.Pig. 4.3(b) shows the ' power 
spectra of the outputs of the linear and non-linear filters 
and the power spectrum of the sinusoidal input, which has 
a period of 1 6T secs. The figure (4.3b) shows a peak for 
the same frequency 1/16T for the outputs of the linear and 
the N~bit feedback sampled-data filters and for the input 
which is sinusoidal. There is a finite dispersion about the 
peak frequency in each case. This is due to the fact that 
a finite number of points (M=80) were used to determine 
the power spectrum in each case. 

(d) White Noise Input: Sec. (3.3.1) discussed in theory the 
performance of a first order nonlinear digital filter, to a 
white noise input. Here we discuss the performance of first 
order nonlinear filters corresponding to linear digital 
filters given by Eqn. (4.2.1) when the input is white noise. 

When simulating a first order nonlinear filter, for 
a particular run of the simulator, the parameters MU and N, 
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Fig. 4 .3(a) Response of first order N~bit 

sampled- data fitter to sinusoidal 
input . 


Power spectrum 
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y(kT) = u(kT) + 0 .75 y (k-lT) 



Fig. 4. 3(b) First order filters , output 

power spectra for sinusoidal input- 



which have been previously defined in Sec. 4.1, have 
particular values. 
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Fig. (4.4a), ( 4 . 4 b), (4.4c) compare the power 
spectra of the outputs of nonlinear IT-bit feedback - 
coarse-sanipled-data filters with those of the corresponding 
linear digital filters. For ct=0.25, (0.5), (0.75) the 
values of MU and IT that give the closest power spectrum 
matching are MU=512, (1024), (512) and N=51 2 , (512) , ( 1024) . 

The parameter IT relates the dither period T' to the 
input sampled period T (I ! =T/lT). Increasing (decreasing) 

IT implies that the dither period T' decreases (increases) 
for a fixed input sampling rate T. It is seen that by 
obtaining the output power spectra for a nonlinear filter, 
for a range of values of IT there is a particular value of 
N that yields the most close matching of the o/p power 
spectrum with that of r.he o/p of the linear digital filter. 

An intuitive explanation may be given. In theory an 
infinite time i.e. N= oo is required for perfect matching 
of the power spectra of the outputs of the nonlinear filter 
and the linear digital filter. However, this is not 
practicable. Hence for low values of IT, there shall be a 
finite error between the spectra. As IT increases, this 
error may decrease. An inherent feature in any finite 
wordlength machine is the introduction of round off /truncation 



Power spectrum 
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Fig. 4 4(a) 


First order filters, output 
power spectra . 



Power spectrum 
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y(kT) = u(kT) + 0.5 y(k-1T) 
MU s 1024 } N = 512 
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Fig. 4 . 4(b) First order filters , output 
power spectra . 



Power spectrum 
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y (kT) = u(kT) + 0.75 y (k-IT) 
MU = 512 , N = 1024 
LIMN =1.00 , T = 0.1 



Fig. 4 •4(c) First order filters, output 

power spectra . 
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noise into the filter. As U increases hound les sly, the 
cumulative effect of the cut-off /truncation noise may 
increase and cause the error between the spectra of the 
linear and the nonlinear filters to increase. However, this 
explanation remains an intuitive one, as no study, either 
theoretical or by simulation has been made to bach it. 

I 

The initial condition response dies down as a 
Hence MU must be large enough for the initial condition 
response to be negligible. Therefore MU must be greater 
as a 1 . However the simulation results show optimal 
values of MU are MU=512 for a =0.25 and 0.75 and MU=1024 
for a=0.5 for each of which 0. 

Second Order Filters ; figs 4.5(a) , (b) , (c) depict the spectra 
for the linear digital filters corresponding to 

y(kT) = u(k)+a 1 y(FTT) + a 2 y(k^2T) (4.2.14) 

and the N-bit feedback sampled -data filters derived from 
them, both for white noise input. 

The simulation program is run to enable one to 
study the effect of MU and Ef on the performance of the 
filter. The behaviour of the nonlinear filters' performance 



Power spectrum 


4.18 



Fig* •5(a) Second order filters, output 
power spectra . 





Power spectrum 
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Fig . 4. 5(e) Second order filters , output 
^ower spectra . 
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with N was consistent with the explanation given for the 
11 white noise input to first order filters” case. For 
a fixed MU, varying N over a particular range, the 
difference between the power spectra of the linear and 
nonlinear filters is minimum for some N, above and below 
which the error increases. Fig. 4.5(b) depicts the 
output power spectra for two different values of IT, for a 
fixed MU. 



CHAPTER 5 

conclusions 

In this chapter the results obtained in the preceding 
study are stated in brief and suggestionsfor further work 
on the problem are mentioned. 

Linear digital filters are characterized by constant 
coefficient difference equations. They can be realized 
using the appropriate units of 1 digital hardware available. 
The coarse~sampled~data filter ms introduced with the 
idea of replacing the linear digital filter with it. The 
expected value of the output of the linear digital filter 
was said to be equal to the expected value of the output 
of the proposed filter. The advantage was that less 
complex hardware was required than in the linear digital 
filter case. However it was noted that due to the 
requirement of a high frequency dithering signal by the 
nonlinear filter, the input signals were constrained to 
those whose Nyquist rates were low. 

In Chapter 3, Section 2 the coarse-sampled-data 
filter using a digital counter averager ms investigated. 

It was found that the output of this filter was equal to 
that of the linear digital filter in neither its expectation 
nor its autocorrelation. The coarse-sampled-data filter 
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structure was modified to yield the IT— "bit feedback sampled - 
data filter investigated in Chapter 5, Section 3. It was 
found that the expected value 0 f the output of the latter 
filter and that of the output of the linear digital filter 
were equal. It was also found that the autocorrelation 
of the output of the E~bit feedback sampled -data filter 
approached asymptotically the autocorrelation of the output 
of the linear digital filter as the dithering rate 
( 1 / T ’ = M/T ) increased, for a fixed input sampling rate 
(l/T). One disadvantage of the IT-bit feedback sampled- 
data filter compared to the coarse-sampled-data filter 
is that for a linear difference equation of order M, the 
corresponding coarse-sampled-data filter requires the 
length of the feedback register to be M, while its modifi- 
cation requires the register length to be MIT, where IT is 
the ratio of the input sampling period T to the period 
of the dither T'. 

In Chapter 4, the results obtained by simulating 
first and second order IT-bit feedback sampled-data 
filters are discussed. It is seen that within a certain 
amplitude range of the input, the E-bit feedback sampled- 
data filter responds as a linear filter. The filter 
requires a minimum 'run time' during which the natural 
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response due to the initial conditions is allowed to 
decay to a negligible value, after which, the power spectra 
of the outputs of the H-bit feedback sampled -data filter and 
the linear digital filter may be compared. It is seen that 
foreack nonlinear filter realised in hardware or simulated 
on the computer, there is a specific dithering rate for a 
fixed input sampling rate for which matching of spectra 
occurs. Below this value of ET, the number of points averaged 
to obtain y(lT) is inadequate, and hence the autocorrelation 
of y(lT) is not equal to that of y(ll). Above this 

, perhaps 

value of N, the error introduced A due to truncation 
and/or rounding 9 increases and causes the power spectrum 
y(lf) to increase above that of y(lT). 



The coarse— sampled —data filter proposed by Kirlin 
has been modified to yield the N-bit sampled-data filter; 
tnis uses a 1-bit quantizer. The results may be extended 
to the case when the quantizer has a greater number of 
quantization levels. A sensitivity analysis may be 
carried out to determine the perturbation in the power 
spectrum due to perturbation of coefficient values. 

A requirement of this nonlinear filter is that the 
input sampling rate be low. Hence the filter may be used 
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m systems that are multi-rate with T ±n > Covariance 

Invariant Multirate Filtering requires that an analog 
f iltei "be replaced by a bank of multirate linear digital 
filters. The outputs oi the individual filters are added 
after being appropriately delayed, to yield the o/p which 
is covariance invariant with the o/p of the analog filter. 
It would be interesting to investigate the power spectrum 
of the Cl MR filter when each of the digital filters 

in the bank, is replaced by an N-bit feedback sampled - 
data filter. 

As stated previously in Chapter 1 , simulators of 
lading dispersive channels require a great amount of 
digital hardware. The linear complex filters could be 
implemented using IT-bit feedback coarse-sampled-data 
filters. A simulation of such a nonlinear complex filter 
would be highly informative of the nonlinear filter's 
performance. 
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PROGRAM FOR THE SIMULATION OF 
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